Phil Austin | 14 Aug 21:35 2012
Picon

ipython notebook not displaying output cells

We're trying to set up ipython 0.13 in an undergraduate lab with Windows 
7 machines
using EPD 7.3, followed by:

easy_install -U ipython
easy_install -U tornado

and

ipython profile create

in a user directory.

opening ipython in either a regular console (Pylab desktop shortcut) or
the qtconsole  both work fine, but when we start a notebook
with

ipython notebook

in firefox 14

command cells appear to execute, but there is no output.
mathjax formatting and markdown cells render fine, however.

A screen shot showing the state after a ctrl-enter:
http://dl.dropbox.com/u/3195815/iPy_notebook.PNG

Quick googling didn't turn up anything exactly like this, but
it seems like firewall settings might be implicated?  Any
suggestions on how to debug are welcome.
(Continue reading)

Phil Austin | 16 Aug 01:34 2012
Picon
Picon

Re: ipython notebook not displaying output cells

Following up -- the problem seems to be related to
Active Directory running on our Windows 7 64bit enterprise server.
Turning off the firewall on a lab client machine doesn't help
(that is, ipython is still unable to make connections to
tcp ephemeral ports)  but if the client machine is rebooted in
networking safe mode then ipython works fine.

googling "Active Directory blocks tcp ports" doesn't produce any
leads, so if anybody has run into similar problems with
a windows server I'd be eager to here about it.

thanks, Phil Austin

--
View this message in context: http://python.6.n6.nabble.com/IPython-User-ipython-notebook-not-displaying-output-cells-tp4985176p4985230.html
Sent from the IPython - User mailing list archive at Nabble.com.
Darren Govoni | 16 Aug 01:47 2012

Re: ipython notebook not displaying output cells

I'm having this problem as well -  with a liberal (but still enabled) firewall. It think its AD.
I don't have any control over the firewall or windows machine. But need to find a way for this to work.

What ports are required to receive the output cells? I have my notebook server running on port 80 (firewall friendly)
and thought that means all comms to the server piggyback on that port. Is that true?

Are there other ports used by notebook we need to be aware of, because right now it doesn't work
through a firewall.

Darren

On Wed, 2012-08-15 at 16:34 -0700, Phil Austin wrote:
Following up -- the problem seems to be related to Active Directory running on our Windows 7 64bit enterprise server. Turning off the firewall on a lab client machine doesn't help (that is, ipython is still unable to make connections to tcp ephemeral ports) but if the client machine is rebooted in networking safe mode then ipython works fine. googling "Active Directory blocks tcp ports" doesn't produce any leads, so if anybody has run into similar problems with a windows server I'd be eager to here about it. thanks, Phil Austin -- View this message in context: http://python.6.n6.nabble.com/IPython-User-ipython-notebook-not-displaying-output-cells-tp4985176p4985230.html Sent from the IPython - User mailing list archive at Nabble.com. _______________________________________________ IPython-User mailing list IPython-User <at> scipy.org http://mail.scipy.org/mailman/listinfo/ipython-user

_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
Phil Austin | 16 Aug 02:01 2012
Picon
Picon

Re: ipython notebook not displaying output cells

On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:


> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json




View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
Darren Govoni | 16 Aug 02:04 2012

Re: ipython notebook not displaying output cells

Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.

On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json





View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com. _______________________________________________ IPython-User mailing list IPython-User <at> scipy.org http://mail.scipy.org/mailman/listinfo/ipython-user

_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
MinRK | 16 Aug 02:17 2012
Picon

Re: ipython notebook not displaying output cells

*each* Kernel requires four ports which are randomly selected - so that's four ports per notebook that you need to have available.

You can certainly subclass the KernelManager such that it will change the random port selection to selecting from a predetermined list, but you will need to make *a lot* of loopback ports available.  Now, you can avoid this issue by using IPC transports instead of TCP, but of course ØMQ does not support IPC transports on Windows.

So I think the answer is probably going to end up being:  The IPython Notebook is not compatible with this kind of environment, unless there are Windows wizards who can figure it out.

On Wed, Aug 15, 2012 at 5:04 PM, Darren Govoni <darren <at> ontrenet.com> wrote:
Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.


On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json





View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________ IPython-User mailing list IPython-User <at> scipy.org http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user


_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
Phil Austin | 16 Aug 02:31 2012
Picon
Picon

Re: ipython notebook not displaying output cells

On 12-08-15 05:17 PM, MinRK [via Python] wrote:


> *each* Kernel requires four ports which are randomly selected - so
> that's four ports per notebook that you need to have available.
> You can certainly subclass the KernelManager such that it will change
> the random port selection to selecting from a predetermined list, but
> you will need to make *a lot* of loopback ports available.  Now, you can
> avoid this issue by using IPC transports instead of TCP, but of course
> ØMQ does not support IPC transports on Windows.
>
> So I think the answer is probably going to end up being:  The IPython
> Notebook is not compatible with this kind of environment, unless there
> are Windows wizards who can figure it out.
>

In our case, the lab is behind an external firewall, so we have no
problem permitting as large a port range as necessary on the
lab server. It's just a question (for me) of
how to tell Active Directory to do that.  -- Phil



View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
Phil Austin | 19 Aug 05:10 2012
Picon
Picon

Re: ipython notebook not displaying output cells

Following up on our problem blocked ports interfering with ipython notebook
output
in a Windows 7 computer lab

Our lab sysadmin killed all the bootinit processes on the server and then
started them
one by one, and the application that interferes with ipython in our case was
"Sophos Web Intelligence Service swi-service".  Disabling that process
allows
us to use the notebook on all lab workstations.

--
View this message in context: http://python.6.n6.nabble.com/IPython-User-ipython-notebook-not-displaying-output-cells-tp4985176p4985651.html
Sent from the IPython - User mailing list archive at Nabble.com.
Darren Govoni | 16 Aug 02:32 2012

Re: ipython notebook not displaying output cells

That's unfortunate, but also not unique to windows either.

Is it because the websockets that use the random ports? I presume there is no kind of "proxy" or tunneling for websockets
to deal with secure environments?

On Wed, 2012-08-15 at 17:17 -0700, MinRK wrote:
*each* Kernel requires four ports which are randomly selected - so that's four ports per notebook that you need to have available.
You can certainly subclass the KernelManager such that it will change the random port selection to selecting from a predetermined list, but you will need to make *a lot* of loopback ports available.  Now, you can avoid this issue by using IPC transports instead of TCP, but of course ØMQ does not support IPC transports on Windows.


So I think the answer is probably going to end up being:  The IPython Notebook is not compatible with this kind of environment, unless there are Windows wizards who can figure it out.

On Wed, Aug 15, 2012 at 5:04 PM, Darren Govoni <darren <at> ontrenet.com> wrote:
Hopefully one of the ipython gurus can help us get this to work through a firewall.
Arbitrary port opening isn't going to work in an enterprise firewall environment I think.


On Wed, 2012-08-15 at 17:01 -0700, Phil Austin wrote:
On 12-08-15 04:47 PM, Darren Govoni [via Python] wrote:

> I'm having this problem as well -  with a liberal (but still enabled)
> firewall. It think its AD.
> I don't have any control over the firewall or windows machine. But need
> to find a way for this to work.
>
> What ports are required to receive the output cells? I have my notebook
> server running on port 80 (firewall friendly)
> and thought that means all comms to the server piggyback on that port.
> Is that true?
>
> Are there other ports used by notebook we need to be aware of, because
> right now it doesn't work
> through a firewall.
>

Here's what I see on a windows laptop without AD -- the output is
coming back through tcp://127.0.0.1:49926 etc. -- Phil

C:\Users\phil>ipython notebook --port 9999
[NotebookApp] Using existing profile dir:
u'C:\\Users\\phil\\.ipython\\profil
efault'
[NotebookApp] Serving notebooks from C:\Users\phil
[NotebookApp] The IPython Notebook is running at: http://127.0.0.1:9999/
[NotebookApp] Use Control-C to stop this server and shut down all kernels.
[NotebookApp] Using MathJax from CDN:
http://cdn.mathjax.org/mathjax/latest/M
Jax.js
[NotebookApp] Kernel started: 99113b7c-ca88-4bef-9294-912080dd91ea
[NotebookApp] Connecting to: tcp://127.0.0.1:49926
[NotebookApp] Connecting to: tcp://127.0.0.1:49928
[NotebookApp] Connecting to: tcp://127.0.0.1:49925
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-99113b7c-ca88-4bef-9294-912080dd91ea.json
[NotebookApp] Kernel started: a7b775b6-3daf-41e0-b92a-d8d054d8ee10
[NotebookApp] Connecting to: tcp://127.0.0.1:50338
[NotebookApp] Connecting to: tcp://127.0.0.1:50339
[NotebookApp] Connecting to: tcp://127.0.0.1:50341
[IPKernelApp] To connect another client to this kernel, use:
[IPKernelApp] --existing kernel-a7b775b6-3daf-41e0-b92a-d8d054d8ee10.json






View this message in context: Re: ipython notebook not displaying output cells
Sent from the IPython - User mailing list archive at Nabble.com.
_______________________________________________ IPython-User mailing list IPython-User <at> scipy.org http://mail.scipy.org/mailman/listinfo/ipython-user



_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user



_______________________________________________ IPython-User mailing list IPython-User <at> scipy.org http://mail.scipy.org/mailman/listinfo/ipython-user

_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user
Thomas Kluyver | 16 Aug 02:36 2012
Picon

Re: ipython notebook not displaying output cells

On 16 August 2012 01:32, Darren Govoni <darren <at> ontrenet.com> wrote:
> Is it because the websockets that use the random ports? I presume there is
> no kind of "proxy" or tunneling for websockets
> to deal with secure environments?

As I understand it, websockets themselves go over port 80. But then
the notebook server forwards the data to the kernel over a ZMQ socket,
which is using the arbitrary ports.

Thomas
MinRK | 16 Aug 02:43 2012
Picon

Re: ipython notebook not displaying output cells



On Wed, Aug 15, 2012 at 5:36 PM, Thomas Kluyver <takowl <at> gmail.com> wrote:
On 16 August 2012 01:32, Darren Govoni <darren <at> ontrenet.com> wrote:
> Is it because the websockets that use the random ports? I presume there is
> no kind of "proxy" or tunneling for websockets
> to deal with secure environments?

As I understand it, websockets themselves go over port 80. But then
the notebook server forwards the data to the kernel over a ZMQ socket,
which is using the arbitrary ports.

Yes, it's not the websockets - it's the notebook server talking to the kernels over ØMQ, where the code is actually running.
On Windows, you simply need to be able to open numerous loopback ports for this to work.  There is no alternative.  There *is* an alternative on platforms other than Windows (IPC).

-MinRK
 

Thomas
_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user

_______________________________________________
IPython-User mailing list
IPython-User <at> scipy.org
http://mail.scipy.org/mailman/listinfo/ipython-user

Gmane