Devon and Cornwall GNU/Linux Users Group

  • About DCGLUG
    • FAQ
    • Join
    • Meetings
      • STEM Group
    • Mailing List Archive
  • About : GNU / Linux
    • Federated social media
    • Video on Free software
    • Video on DRM
    • Video on Creative Commons
    • Hacker / Hacking definition
  • Tutorials
    • BASH Tutorials
    • e-learning
    • My Sql
    • LaTeX and Overleaf
    • Send Plain text e-mail
    • Tutorial : GnuPG – Encryption & Signing
  • CHAT (IRC) / Matrix
    • IRC – Client Setup
      • Weechat Setup guide
      • Hexchat Setup
      • IRSSI Configuration
      • xchat – setup
      • ERC Setup
      • Chat – Matrix
    • DCGLUG on Mastodon

Cluster Progress

Posted on February 19, 2015 by Matthew Lugg

At the Raspberry Pi Jam on Saturday the 14th I was working on creating a cluster supercomputer with a piece of software, GNU Parallel. It was successful, and I did a test with the prime number generator Paul made. It seems to require me to copy all files involved to all computers involved. However, it appears around 40% faster when using two computers instead of just one.

It appears that GNU Parallel has trouble finding the amount of cores on each computer, which is likely the reason for Paul’s inital results, which showed not using parallel to be faster. For all computers it says ‘Could not find the amount of cpu’s on 192.168.1.x, using 1’. It is possible to specify to parallel how many cores computers have, so I will research this.

At Minecraft club on Wednesday, we attempted to link Parkfield’s netbooks together with their switch. We discovered something extremely odd; the Linux netbooks there, along with one of the laptops from Raspberry Pi jams, do not have OpenSSH Server (sshd) installed, even though it is meant to be installed by default on Linux. One of the netbooks wouldn’t let us install it either, but that didn’t really matter – it just meant we had to use parallel on that machine instead of another. We didn’t get time to run a test, but we should have time next Wednesday.

Although so far we have just used GNU Parallel with a python program, it can be extremely useful. For example if you have a password-protected archive with important files, but you forgot the password, you can decrypt the folder much quicker with more processing power.

Posted in Uncategorized | 2 Comments
« Torbay Community Development Trust
Another reason to use FLOSS »

2 thoughts on “Cluster Progress”

  1. Ole Tange says:
    February 26, 2015 at 12:38 am

    GNU Parallel uses GNU Parallel to determine the number of cpus on a machine. Is GNU Parallel installed on the slaves?

    Reply
    • Matthew Lugg says:
      February 26, 2015 at 8:14 am

      No,I didn’t know that’s how it worked. Will try that next Wednesday, should get better performance.

      Reply

Leave a comment Cancel reply

Your email address will not be published. Required fields are marked *

Recent Posts

  • STEM Group May 2022
  • May Events
  • STEM Group April 2022
  • Debian Conference 2022
  • April Events

RSS Debian Security

  • DSA-5148 chromium
  • DSA-5147 dpkg
  • DSA-5145 lrzip

RSS Debian News

  • Updated Debian 11: 11.3 released
  • Updated Debian 10: 10.12 released
  • Updated Debian 11: 11.2 released

CyberChimps WordPress Themes

© 2021 Devon and Cornwall GNU/Linux Users Group