Trusty support

[LinusU]

Fixed up the code in #435 and made it work. I used the following packer.io file to get build the ami, inspired by the discussion in #531.

{
  "builders": [{
    "type": "amazon-ebs",
    "region": "eu-west-1",
    "source_ami": "ami-47a23a30",
    "instance_type": "g2.2xlarge",
    "ssh_username": "ubuntu",
    "ami_name": "Ubuntu 14.04 STAR Cluster - {{timestamp}}"
  }],
  "provisioners": [{
    "type": "shell",
    "inline": [
      "sudo DEBIAN_FRONTEND=noninteractive apt-get update",
      "sudo DEBIAN_FRONTEND=noninteractive apt-get dist-upgrade -y",
      "sudo DEBIAN_FRONTEND=noninteractive apt-get install -y nfs-kernel-server nfs-common portmap",
      "sudo DEBIAN_FRONTEND=noninteractive apt-get install -y gridengine-client gridengine-common gridengine-master gridengine-qmon"
    ]
  }]
}

[LinusU]

Fixed the problem in #535 by using restart instead of start

[cancan101]

One issue is that you might want to copy the installed sge to the folder that is expected by StarCluster: /opt/sge-fresh.

[LinusU]

Yes, the packer.io file is far from complete. But I think that that is the next step; to provide an official AMI with Ubuntu 14.04.

This will be the first step thought; just making sure that StarCluster actually can handle trusty nodes.

[BrunoGrandePhD]

I've also been interested in creating an Ubuntu 14.04 AMI for StarCluster. I decided, like @LinusU, to create a Packer.io recipe, as suggested in #531. I also shamelessly borrowed the SGE tarball and commands from @rustandruin's repository. This way, we stick with the /opt/sge-fresh installation that StarCluster expects. In the long run though, it would be great to move to using the SGE installation from running sudo apt-get install gridengine-*

In my case, I also wanted to enabled Enhanced Networking. Feel free to fork my Packer recipe and tailor to your own needs. I've tested this using @LinusU's PR (7ebffb4) and I was able to instantiate a cluster and submit a job. It'd be great if others are able to reproduce this.

You can find the Packer.io recipe in my repository. I kept seeing references to having to install Java, which I figured out how. If it isn't necessary, I would appreciate any help stripping the recipe to the bare minimum. From that, we could perhaps create different StarCluster AMI flavours (e.g. scientific).

All this being said, it would be great to see this PR merged, so that these AMIs become officially supported, since they depend on rpcbind.

[LinusU]

@jtriley Any chance of getting this merged?

[LinusU]

@jtriley ping!

[BrunoGrandePhD]

@LinusU, you might have better luck with one of the active forks.

https://github.com/datacratic/StarCluster

[LinusU]

Closing this then...