Take a look at PyRO (Python Remote objects) It has the ability to set up services on all the computers in your cluster, and invoke them directly, or indirectly through a name server and a publish-subscribe mechanism.
Answer from Jim Carroll on Stack OverflowIs there a python IDE which can execute the code on a remote server and get the result back? So on the server there should be running a remote daemon for handling the requests. And the solution should be ready to use out of the box. If possible SSH should not be used.
Edit: thanks for hints about SSH firewalls, blocked SSH, SSH port numbers, intensive use of SSH, no-SSH-trolls, SSH denier and so on. My solution seems to be jupyter desktop. Thanks u/NewDateline
How to run an script remotely
Hacky library to run python code on remote machines, a good idea?
You don't need anything for this that isn't already present on a standard unix-ish system. Just pipe your python script into an ssh command to run the python interpreter on the remote. It's a remote full program run, not a remote function call, but I'd wager that for most real use cases, this is what you want anyway. It also works for any interpreted language, not just python.
More on reddit.comHas anyone been able to connect Spyder to a remote kernel?
Python IDE that connects to a remote server
Looks like PyCharm can do it. Remote interpreter https://www.jetbrains.com/pycharm/quickstart/index.html
More on reddit.comVideos
Take a look at PyRO (Python Remote objects) It has the ability to set up services on all the computers in your cluster, and invoke them directly, or indirectly through a name server and a publish-subscribe mechanism.
It sounds like you want to do the following.
Define a shared filesystem space.
Put ALL your python source in this shared filesystem space.
Define simple agents or servers that will "execfile" a block of code.
Your client then contacts the agent (REST protocol with POST methods works well for
this) with the block of code. The agent saves the block of code and does anexecfileon that block of code.
Since all agents share a common filesystem, they all have the same Python library structure.
We do with with a simple WSGI application we call "batch server". We have RESTful protocol for creating and checking on remote requests.