Mesh/MeshApps - Revision history

Maxb: Refactoring MeshApps page

2015-07-22T06:16:30Z

Refactoring MeshApps page

@@ Line 1: / Line 1: @@
-What sort of applications (apps) and services would we like to see the community integrate with the network? See also about [[Mesh/Local_servers|local server]] choices.
+What should live on the network?
-A large amount of our technical research is on the [[Mesh/Distributed_Services|Distributed Services]].
+=Server Setup and Configuration=
 =Use Cases=
-==Leisure, Treasure Hunt, Animal Spotting, History / Science Plotting , Art/Design/Drawing, Mapping Secret/Weird stuff, Expression, Emotion==
+[[Mesh/MeshApps/UseCases|UseCases]]

Maxb at 06:05, 22 July 2015

2015-07-22T06:05:08Z

← Older revision		Revision as of 23:05, 21 July 2015
Line 1:		Line 1:
	What sort of applications (apps) and services would we like to see the community integrate with the network? See also about [[Mesh/Local_servers\|local server]] choices.		What sort of applications (apps) and services would we like to see the community integrate with the network? See also about [[Mesh/Local_servers\|local server]] choices.

			A large amount of our technical research is on the [[Mesh/Distributed_Services\|Distributed Services]].

	=Use Cases=		=Use Cases=

Jwentwistle: moved stuff to distributed services

2014-07-19T00:26:27Z

moved stuff to distributed services

← Older revision		Revision as of 17:26, 18 July 2014
Line 1:		Line 1:
	What sort of applications (apps) and services would we like to see the community integrate with the network? See also about [[Mesh/Local_servers\|local server]] choices.		What sort of applications (apps) and services would we like to see the community integrate with the network? See also about [[Mesh/Local_servers\|local server]] choices.

	~~=Services=~~

	The network ''should'' provide secure communication services (email, contacts, calendar, phone) to create more incentive to be on the network. The services can be integrated into a user account distributed database with master-master replication and low latency (ex. [http://www.datastax.com/resources/whitepapers/benchmarking-top-nosql-databases Cassandra]). These services will use existing open source projects.

	~~==Storage / File Systems==~~

	There are several options for a distributed file system and each have there advantages and disadvantages. The distributed file system can be used to offer file storage or reduce latency across the network.

	* [http://opensfs.org/lustre/ Lustre] - Used by sixty percent of the top 100 websites.
	** Performance: Amazingly fast! I can assert that Lustre can serve a lot of streams and that encoding speed is not affected by accessing files via Lustre.
	** [http://en.wikipedia.org/wiki/POSIX POSIX] compatibility: Very good!. No need to modify applications to use luster.
	** Replication, Load Balancing and Fail Over: Very bad!. For replication load balancing we and fail over we need to rely on other software such as virtual IPs and DRDB.
	** Installation: The worst!. Impossible to install by mere mortals. Requires a very specific combination of kernel, lustre patches and tweaks to get it working. And current luster patches usually work with old kernels that are incompatible with new hardware/software.

	* [https://code.google.com/p/mogilefs/ MogileFS]
	** Performance: Good for small files but not usable for medium to large files. This is mostly due to HTTP overhead since all files are send/receive via HTTP requests that encode all data in base64 adding a 33% overhead to each file.
	** POXIS compatibility: Non existent. All applications require to be modified to use MogileFS that renders it useless for streaming/encoding since most streaming servers and encoding tools do not understand the protocol.
	** Replication and failover out of the box and load balancing can be implemented in the application by accessing more than one tracker at a time.
	** Installation: Relatively easy and ready to use packages exist in most distributions. The only difficulty I found was setting the database master-slave to eliminate the single point of failure.

	* [http://www.gluster.org/ GlusterFS]
	** Performance: Very bad for streaming. I cannot reach more than a few Mbps in a 10Gbps network. Clients and Server CPU skyrockets on heavy writes. For encoding works because the CPU is saturated before the network and I/O.
	** POXIS: Almost compatible. The tools I use can access gluster mounts as normal folders in disk but in some edge cases things start causing problems. Check gluster mailing lists and you will see there are a lot of problems.
	** Replication, Failover and Load balancing: The best! if they actually worked. Gluster is very new and it has a lot of bugs and performance problems.
	** Installation is too easy. The management command line is amazing and setting replicated, striped and distributed volumes among several servers can not be any easier.

	~~([http://stackoverflow.com/questions/916902/lustre-gluster-or-mogilefs-for-video-storage-encoding-and-streaming source of above information])~~

	* [http://hadoop.apache.org/ Hadoop] (HDFS) - slow and has a lot of proprietary derivatives (MapR, GPFS, and [http://gigaom.com/2012/07/11/because-hadoop-isnt-perfect-8-ways-to-replace-hdfs/ other alternatives])
	* [http://www.xtreemfs.org/ XtreemFS] - slow and we need more research on it.
	* Cassandra File System (CFS) - proprietary software made by DataStax and included in the Enterprise Edition of their software.
	* [http://en.wikipedia.org/wiki/Network_File_System Network File Sytem] (NFS) - comparable to Lustre, but the [http://wiki.lustre.org/index.php/NFS_vs._Lustre IO bandwidth doesn't scale].

	~~'''Non-distributed file systems'''~~
	~~There's the option to use a modern file system with [http://en.wikipedia.org/wiki/Rsync rsync].~~
	~~[http://rudd-o.com/linux-and-free-software/ways-in-which-zfs-is-better-than-btrfs Comparison of ZFS and BTRFS]~~
	~~[http://porky.linuxjournal.com:8080/LJ/218/11250.html A Quick Introduction to Modern Filesystems]~~

	~~==Databases and Servers==~~

	These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref>[http://www.strixsystems.com/products/datasheets/strixwhitepaper_multihop.pdf Solving the Wireless Mesh Multi-Hop Dilemma]</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.

	* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.
	* [https://couchdb.apache.org/ CouchDB] - I can tell you that it quickly becomes complicated to write multi-user app with CouchDB. Decent access control means that you need a database per user and likely a few extra databases. You then have to set all of these databases up to synchronize between each other which is further complicated by the limitations on what information is available by the limitations on how synchronization rules and filters can be written. There seem to be no good tools for managing/visualizing these complex relationships so you end up having to roll your own.
	* [http://pouchdb.com/ PouchDB] - a javascript based couchDB.
	* [https://github.com/dominictarr/scuttlebutt Scuttlebutt] - a data synchronization protocol, or a peer-to-peer replicable data structure.
	* [https://tahoe-lafs.org/trac/tahoe-lafs TahoeLAFS] - a decentralized database.
	* [http://code.google.com/p/leveldb/ LevelDB] - a fast and lightweight key/value database library.
	* [http://www.mongodb.org/ MongoDB] - an open-source document database, a NoSQL database. Written in C++.
	* [http://nodejs.org/ Node.js] - an HTTP server written in javascript.

	~~==Communications==~~

	*[http://radicale.org/ Radicale] - a CalDAV (calendar) and CardDAV (contacts) server.
	*[http://keithp.com/blogs/calypso/ Calypso] - Radicale fork with a git back-end (by Keith Packard of X11 fame)
	*[http://villagetelco.org Village Telco] - an initiative to build low-cost community telephone network hardware and software that can be set up in minutes anywhere in the world. No mobile phone towers or land lines are required, it uses the internet. It has a Simple Unified Dashboard (SPUD) for mesh networks.
	*[https://ripple.com/currency/ Ripple] (XRP) - a math-based crypto-currency designed to work seamlessly with the Internet. Powered by a global network of computers; a fast, direct, and secure way to send payments on the web. '''It can be used to prevent malious attacks on servers.'''
	*[http://openbts.org/ OpenBTS] - open source cell phone tower software.
	*[http://www.openmama.org/what-is-openmama OpenMAMA] - a high performance middleware agnostic messaging API that interfaces with a variety of message oriented middleware systems
	*an encrypted asynchronous messaging system to replace email
	*a module to have collaborative documents, voting, and groups (ie. [http://en.wikipedia.org/wiki/Collaborative_software groupware])
	** Read information about the [http://mitar.tnode.com/post/73983101095/peer-to-peer-voting-scheme peer-to-peer voting scheme].
	*a module for peer to peer file sharing.
	*a module for object-orientated tagging, shareable feeds.
	*a module for feeds and posts, such as [http://www.trsst.com/ Trsst].
	* [http://www.frontlinesms.com/ Frontline SMS] - a free, open-source desktop application that allows you to send texts.

	~~==Mapping==~~

	* [http://nodewatcher.readthedocs.org/en/latest/installation.html NodeWatcher] - an open source network planning, deployment, monitoring and maintanance platform.
	* [http://wiki.ninux.org/InstallNodeshot NodeShot] - an easy to use wireless community map server.
	* [https://github.com/freifunk/openwifimap-html5 OpenWiFiMap] - a database and map for free network WiFi routers (freifunk and others, too!).
	* [https://github.com/libremap LibreMap] - a scalable, global and decentralized router database and map visualization for community networks, such as guifi, ninux, etc.
	* [http://tidepools.co Tidepools] - collaborative local mapping software
	* [http://ediblecities.org/ Edible Cities] - a food mapping project
	* Bulletin Board / Local Classified Ads
	** Community Asset Mapping (ex. [http://thepyre.org/wiki/Mycelia Mycelia])

	~~== Protocols ==~~
	* [https://tent.io/ Tent] - a method to store all your data in one place that you control. Instead of your digital life being spread across many services.
	* [https://www.docker.io/ Docker] - an open-source project to easily create lightweight, portable, self-sufficient containers from any application.
	* [http://maidsafe.net/ MaidSafe] - an encrypted, fully distributed data management service. This network manages static and dynamic data as well as communications. (charges money)

	~~== Social Platforms ==~~
	* [https://joindiaspora.com/ Diaspora] - a decentralized social network
	* [https://identi.ca/ Identi.ca] - a high-performance Open Source social engine.
	* [http://pump.io/ Pump] - a stream server that does most of what people really want from a social network.
	* [http://twister.net.co/ Twister] - a decentralized, peer to peer microblogging platform

	~~==Utilities and Misc.==~~
	* [https://sudoroom.org/wiki/Mesh/Firmware/Zeroconf Avahi] - a mDNS responder that allows you to broadcast services
	* [http://localwiki.org/ Local Wiki] - create a local wikipedia (eg; http://oaklandwiki.org)
	* a module for sensor data (eg; Temperature, Seismic activity, air pollution)
	* [http://dev.wlan-si.net/wiki/PiplMesh PiplMesh] - an open source social networking and info portal for wireless networks used as a welcome page when users connect to the network.
	* [https://neocities.org/ Neocities] ([https://github.com/neocities/neocities git]) - create free user sites
	* [http://crabgrass.riseuplabs.org/ Crabgrass] - a project out of riseup labs, a ruby rails application for community organizing. It's not the easiest to run your own instance, but very easy to sign up to their server ([https://we.riseup.net/ we.riseup.net])

	=Use Cases=		=Use Cases=

Aep at 21:23, 5 July 2014

2014-07-05T21:23:41Z

← Older revision		Revision as of 14:23, 5 July 2014
Line 55:		Line 55:

	*[http://radicale.org/ Radicale] - a CalDAV (calendar) and CardDAV (contacts) server.		*[http://radicale.org/ Radicale] - a CalDAV (calendar) and CardDAV (contacts) server.
			*[http://keithp.com/blogs/calypso/ Calypso] - Radicale fork with a git back-end (by Keith Packard of X11 fame)
	*[http://villagetelco.org Village Telco] - an initiative to build low-cost community telephone network hardware and software that can be set up in minutes anywhere in the world. No mobile phone towers or land lines are required, it uses the internet. It has a Simple Unified Dashboard (SPUD) for mesh networks.		*[http://villagetelco.org Village Telco] - an initiative to build low-cost community telephone network hardware and software that can be set up in minutes anywhere in the world. No mobile phone towers or land lines are required, it uses the internet. It has a Simple Unified Dashboard (SPUD) for mesh networks.
	*[https://ripple.com/currency/ Ripple] (XRP) - a math-based crypto-currency designed to work seamlessly with the Internet. Powered by a global network of computers; a fast, direct, and secure way to send payments on the web. '''It can be used to prevent malious attacks on servers.'''		*[https://ripple.com/currency/ Ripple] (XRP) - a math-based crypto-currency designed to work seamlessly with the Internet. Powered by a global network of computers; a fast, direct, and secure way to send payments on the web. '''It can be used to prevent malious attacks on servers.'''

Aep at 21:17, 5 July 2014

2014-07-05T21:17:04Z

← Older revision		Revision as of 14:17, 5 July 2014
Line 11:		Line 11:
	* [http://opensfs.org/lustre/ Lustre] - Used by sixty percent of the top 100 websites.		* [http://opensfs.org/lustre/ Lustre] - Used by sixty percent of the top 100 websites.
	** Performance: Amazingly fast! I can assert that Lustre can serve a lot of streams and that encoding speed is not affected by accessing files via Lustre.		** Performance: Amazingly fast! I can assert that Lustre can serve a lot of streams and that encoding speed is not affected by accessing files via Lustre.
	** [http://en.wikipedia.org/wiki/POSIX ~~POXIS~~] compatibility: Very good!. No need to modify applications to use luster.		** [http://en.wikipedia.org/wiki/POSIX POSIX] compatibility: Very good!. No need to modify applications to use luster.
	** Replication, Load Balancing and Fail Over: Very bad!. For replication load balancing we and fail over we need to rely on other software such as virtual IPs and DRDB.		** Replication, Load Balancing and Fail Over: Very bad!. For replication load balancing we and fail over we need to rely on other software such as virtual IPs and DRDB.
	** Installation: The worst!. Impossible to install by mere mortals. Requires a very specific combination of kernel, lustre patches and tweaks to get it working. And current luster patches usually work with old kernels that are incompatible with new hardware/software.		** Installation: The worst!. Impossible to install by mere mortals. Requires a very specific combination of kernel, lustre patches and tweaks to get it working. And current luster patches usually work with old kernels that are incompatible with new hardware/software.

Jwentwistle: added link to white paper

2014-07-01T02:05:36Z

added link to white paper

← Older revision		Revision as of 19:05, 30 June 2014
Line 41:		Line 41:
	==Databases and Servers==		==Databases and Servers==

	These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref> Solving the Wireless Mesh Multi-Hop Dilemma</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.		These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref>[http://www.strixsystems.com/products/datasheets/strixwhitepaper_multihop.pdf Solving the Wireless Mesh Multi-Hop Dilemma]</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.

	* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.		* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.

Jwentwistle: added references section

2014-07-01T02:04:24Z

added references section

← Older revision		Revision as of 19:04, 30 June 2014
Line 126:		Line 126:
	*Jen is a 30-year-old Asian-American technologist and community organizer in East Oakland. Passionate about DIY education and grassroots community-building, she's interested in mapping DIY communities as well as available resources for crisis readiness (such as relief centers, tools, food, water and shelter).		*Jen is a 30-year-old Asian-American technologist and community organizer in East Oakland. Passionate about DIY education and grassroots community-building, she's interested in mapping DIY communities as well as available resources for crisis readiness (such as relief centers, tools, food, water and shelter).
	*Alexis is a 29-year old African-American technologist interested in the potential for mesh networking to expand internet access in underserved areas and creating a resilient communications network for crisis readiness. She is especially passionate about issues surrounding access to technology, and would like to see underserved communities participating in putting themselves on the map.		*Alexis is a 29-year old African-American technologist interested in the potential for mesh networking to expand internet access in underserved areas and creating a resilient communications network for crisis readiness. She is especially passionate about issues surrounding access to technology, and would like to see underserved communities participating in putting themselves on the map.

			=References=
			<references />

Jwentwistle: /* Databases and Servers */ changed references

2014-07-01T02:02:27Z

Databases and Servers: changed references

← Older revision		Revision as of 19:02, 30 June 2014
Line 41:		Line 41:
	==Databases and Servers==		==Databases and Servers==

	These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref>~~[http://www.strixsystems.com/products/datasheets/strixwhitepaper_multihop.pdf~~ Solving the Wireless Mesh Multi-Hop Dilemma]</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.		These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref> Solving the Wireless Mesh Multi-Hop Dilemma</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.


	* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.		* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.

Jwentwistle: /* Databases and Servers */ added information about decentralized databases

2014-07-01T02:00:58Z

Databases and Servers: added information about decentralized databases

← Older revision		Revision as of 19:00, 30 June 2014
Line 40:		Line 40:

	==Databases and Servers==		==Databases and Servers==

			These are decentralized databases and servers that could ultimately be optimized to store data nearest to where people access it. A significant factors with mesh networks, that as "size and complexity continues to grow, mesh networks that contain multiple hops become increasingly vulnerable to problems such as bandwidth degradation, radio interference and network latency.<ref>[http://www.strixsystems.com/products/datasheets/strixwhitepaper_multihop.pdf Solving the Wireless Mesh Multi-Hop Dilemma]</ref>" There are several other methods of improving network latency, but all means should be tested and implemented to improve services.


	* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.		* [https://cassandra.apache.org/ Cassandra] - a decentralized database with asynchronous masterless replication allowing low latency operations for all clients. Cassandra has [http://en.wikipedia.org/wiki/Hadoop Hadoop] integration, with MapReduce support.

Jwentwistle: /* Communications */ changed language to ripple

2014-07-01T01:45:29Z

Communications: changed language to ripple

← Older revision		Revision as of 18:45, 30 June 2014
Line 54:		Line 54:
	*[http://radicale.org/ Radicale] - a CalDAV (calendar) and CardDAV (contacts) server.		*[http://radicale.org/ Radicale] - a CalDAV (calendar) and CardDAV (contacts) server.
	*[http://villagetelco.org Village Telco] - an initiative to build low-cost community telephone network hardware and software that can be set up in minutes anywhere in the world. No mobile phone towers or land lines are required, it uses the internet. It has a Simple Unified Dashboard (SPUD) for mesh networks.		*[http://villagetelco.org Village Telco] - an initiative to build low-cost community telephone network hardware and software that can be set up in minutes anywhere in the world. No mobile phone towers or land lines are required, it uses the internet. It has a Simple Unified Dashboard (SPUD) for mesh networks.
	*[https://ripple.com/currency/ Ripple] - a math-based currency designed to work seamlessly with the Internet. Powered by a global network of computers~~, XRP is~~ a fast, direct, and secure way to send payments on the web. '''~~This could~~ be used ~~in servers~~ to prevent malious attacks on servers.'''		*[https://ripple.com/currency/ Ripple] (XRP) - a math-based crypto-currency designed to work seamlessly with the Internet. Powered by a global network of computers; a fast, direct, and secure way to send payments on the web. '''It can be used to prevent malious attacks on servers.'''
	*[http://openbts.org/ OpenBTS] - open source cell phone tower software.		*[http://openbts.org/ OpenBTS] - open source cell phone tower software.
	*[http://www.openmama.org/what-is-openmama OpenMAMA] - a high performance middleware agnostic messaging API that interfaces with a variety of message oriented middleware systems		*[http://www.openmama.org/what-is-openmama OpenMAMA] - a high performance middleware agnostic messaging API that interfaces with a variety of message oriented middleware systems
Line 63:		Line 63:
	*a module for object-orientated tagging, shareable feeds.		*a module for object-orientated tagging, shareable feeds.
	*a module for feeds and posts, such as [http://www.trsst.com/ Trsst].		*a module for feeds and posts, such as [http://www.trsst.com/ Trsst].
	* [http://www.frontlinesms.com/ Frontline SMS] - a free, open-source desktop application that allows you to send texts.		* [http://www.frontlinesms.com/ Frontline SMS] - a free, open-source desktop application that allows you to send texts.

	==Mapping==		==Mapping==