Open Source Python Distributed Computing Software - Page 6

Universal information crawler is a fast precise and reliable Internet crawler. Uicrawler is a program/automated script which browses the World Wide Web in a methodical, automated manner and creates the index of documents that it accesses.

"Virtual Infrastructure for Applications and Services Over IP" ViaSIP_NG using latest OpenCloudComputing recommendations to develop Scalable Private-Public cloud platforms. ViaSIP is leveraging ODS - LinkedData, CouchDB, Eucalypus, DatR.ws & Web2Py.

Virtual NetManager WAS a GTK frontend for VDE and QEMU. This project has been recently merged with Qemulator, and became Check the home page for the new project!!

Design and development of visual programming interface to allow specification, loading, execution and termination of specified simulation runs. It should be capable of allowing secure remote control flow setup, execution / termination of simulation jobs

An implementation model for unifying Aspect Oriented Programming and Service Oriented Architecture.

WatchTower is a cloud server monitoring and management tool. This is actually a suite of tools that includes a dashboard and associated RESTful web services required for managing the servers and services. The dashboard uses PHP/MySQL (requires php5+), html, and css. It's all open source and very easy to work with and make changes. The client I'm using is included and is written in python. Currently tested with Python 2.4 and 2.6, but should work with any version. I'm not using anything special. My plans also include monitoring/managing of Windows servers through the same python client, but compiled into a working exe, but I will work on that when the Linux client is finished first.

WeatherMatrix project that weather remind service suit,is consist of wxWeather that client side,weather reminder program wxWidget-based and Weather Community that wxWeather auxiliary part,server side,provide opening weather service.

XtreemOS project aims at building a Linux-based operating system to support virtual organizations for next generation Grids.

YAML (tm) is a straight-forward data serilization language, offering an alternative to XML where markup (named lists and mixed content) are not needed. YAML borrows ideas from rfc822, SAX, C, HTML, Perl, and Python.

Zeus Grid is a Grid Computing environment usefull to run systems in heterogenous machines at same time. In this first step, it will only compile, run and collect application results and file storage.

This is a software agent based computing program that will enable researchers and other users to tap in computing power of machine available by sharing work load on the fly with zero configuration on network & resources A self organizing agent program that will understand network and its resource. where as the only job left to researcher is to split up jobs in several chunks of programs either parallel or sequential jobs and go issue the job (A visual Modeler or Scripting support need to be yet designed) Software agents will automatically manage the rest or resource management, sharing , cloning of tasks etc. new resources can be added and removed from the system on fly; in layman terms the project will create an agent program that enable sharing & execution of program among all the available resources whether it be desktop, laptop, pda . thereby one can accelerate research to the very extent of resource availability with out bothering about anything... C++11v Upcoming.

asyncoro is a Python framework for developing concurrent, distributed, network programs with asynchronous completions and coroutines. Asynchronous completions implemented in asyncoro are sockets (non-blocking sockets), database cursors, sleep timers and locking primitives. Programs developed with asyncoro have same logic and structure as Python programs with threads, except for a few syntactic changes. asyncoro supports socket I/O notification mechanisms epoll, kqueue, /dev/poll (and poll and select, where necessary), and Windows I/O Completion Ports (IOCP) for high performance and scalability, and SSL for security

Carina is a software for accessing and managing private/local, public/remote and hybrid cloud environments.

a distributed engine for abstract neural network development via natural-language programming

HPC cloud computing for OpenFOAM (R) users

Software for accessing and managing private/local, public/remote and hybrid cloud environments.

Are you maitaining many machines and bored with the tedious operation of logging to those machines one by one just for checking the machine's status? Or are you losing patient for your simple script that have to run command in those machines in sequence? The corunner is just for those senarios. It's designed to speed up execution in your machines. It can executes command in handreds of or thousands of machines concurrently. Provide it with your files and command and the machines' location, it will do everything for you. Besides that, it monitors every process in the remote machine and displays that in your controller. Through this, you can learn about all progresses in the remote machines easil y. And there is also one additional tool that make you transport files from or to those machines concurrently. That will promote your efficiency greatly.

distX is a script which can be used to distribute CPU intensive tasks to a cluster of machines. For example, distX has been used for distributed encoding of ogg vorbis files.

This tool lets you login with SSH to a group of machines and interact with them as if they were one machine. Each command that you enter is run in parallel on all machines in the group. The output from each machine is printed separately.

managerComp is an application used to monitor and manage Ice components (http://www.zeroc.com) under GNU/Linux environments. It displays the components, their states and dependences using a graph view.

[This project moved to Github and is no longer maintained here] Minimum intrusion Grid (MiG) is an attempt to design a new platform for Grid computing which is driven by a stand-alone approach to Grid, rather than integration with existing systems. The goal of the MiG project is to provide Grid infrastructure where the requirements on users and resources alike is as small as possible (minimum intrusion). MiG strives for minimum intrusion but will seek to provide a feature rich and dependable Grid solution. In line with the minimum intrusion concept, you only need to download and install the middleware if you want to run your own Grid. Users and resources only need a certificate and a browser to use MiG.

Publish and subscribe messaging for the Web, and related tools. Our license is BSD.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

Python Integrated Parallel Programming EnviRonment (PIPPER), Python pre-parser that is designed to manage a pipeline, written in Python. It enables automated parallelization of loops. Think of it like OpenMP for Python, but it works in a computer cluster