The Tide

Inspired by Charles Moores Forth programming language, his MISC processors and arrays of them and by the pacific ocean I was urged to write a proposal for massively distributed programming:

http://www.magma.com.ni/~jorge/tide.html

The pictures are missing, but in the ?[http:/~jorge/tide.pdf PDF Version] they are proudly present.

Comments

  • Efficiency: A strength of Forth programs is factorization. If very small Forth programs are executed on lots of diferent computers, how would this weaken the aproach?
  • Stability: If a processor getÅ› blocked - stuck in an endless loop - it no further contributes to processing and there is no way to get it back to work again, not even to diagnose the situation.

References

http://www.colorforth.com/chips.html

  • [..] 18-bit computer to match available fast SRAM [..] using dynamic latches, and has on-chip ROM and DRAM to sustain 2400 Mips. Its small size and on-chip memory leads to the 25x with multiple computers on the same die. http://www.ultratechnology.com/chatlog.htm

  • I'm exploring parallel computing with very small. very fast computers. 64 word of ROM, 128 words of RAM, 2400 Mips. Processor tasks are programmer assigned partly dependent on unique processor capabilities. There are 25 independent instruction streams 63,000 Mips total, programmable http://slashdot.org/interviews/01/09/11/139249.shtml

  • [..] the assignment and coding of computers follows the data flow. [..] http://en.wikipedia.org/wiki/Non-Uniform_Memory_Access

  • [..] non-cache-coherent NUMA systems are prohibitively complex to program in the standard von Neumann programming model. [..] all fielded NUMA designs use special-purpose hardware to maintain cache coherence [..]

  • The addition of virtual memory paging to a cluster architecture can allow NUMA to be implemented entirely in software
    http://en.wikipedia.org/wiki/Cluster_computing

  • Clusters ...] not only support parallel computing, but also shared file systems and peripheral devices http://cne.gmu.edu/modules/dsm/yellow/page_dsm.html

  • The idea behind DSM is simple: Try to emulate the cache of a multiprocessor using the MMU and operating system software http://www.ultratechnology.com/4thlinda.html#flinda

  • Linda is a coordination language that can be combined with a standard computational programming language to provide multiprocessor coordination and communication using a tuple space model. [..] there is a master processor which manages the network, or simulated network, and multiple worker processors which process active tuples given to them by the master processor. http://www-itg.lbl.gov/

  • Berkley Lab: Distributed Systems Department http://www.cs.duke.edu/~alvy/courses/221/lectures/week5-l1.ps

  • Large Scale Machines