Issue788

Title Create End-User Fast Downward Singularity Container
Priority feature Status in-progress
Superseder Nosy List cedric, florian, guillem, jendrik, malte, silvan
Assigned To guillem Keywords infrastructure
Optional summary
See also the related issue787.

Created on 2018-05-11.17:18:11 by guillem, last changed by malte.

Summary
See also the related issue787.
Messages
msg8085 (view) Author: malte Date: 2018-11-26.12:15:00
If we go forward with this, it may be useful to support docker in addition to
singularity due to its wider use.
msg7197 (view) Author: guillem Date: 2018-06-05.11:56:18
> Is there a way to update the usage instructions on
Singularity hub
Umm  cannot find one, but the issue should be solved once we provide a "by default" image 
which gets pulled whenever no particular tag is specified.

> Also, how do you like the idea of adding the mercurial revision of the main repo
as a tag to the meta data of the container?

Sounds very good, I'll see how to best implement that.
msg7196 (view) Author: florian Date: 2018-06-05.11:52:25
That works, thanks. Is there a way to update the usage instructions on
Singularity hub (https://www.singularity-hub.org/collections/1067/usage)?
Because they do not mention the tag and just following them produces the error
below.

Also, how do you like the idea of adding the mercurial revision of the main repo
as a tag to the meta data of the container? This way, you could query the
container to find out when and how it was built.
msg7195 (view) Author: guillem Date: 2018-06-05.11:26:20
Yes, there's no "default" fast-downward image yet, so you have to pull with the full tag 
name, e.g.

singularity pull shub://gfrances/fast-downward:18.06

As for the Singularity Hub error message, no idea what it refers to, but I'll have a closer 
look.
msg7194 (view) Author: florian Date: 2018-06-05.11:22:25
I tried pulling the image and got an error:

> singularity pull shub://gfrances/fast-downward
ERROR Cannot find image. Is your capitalization correct?

Clicking on the name of the container on the website also showed an error:
  We had an issue retrieving files for this container! Try another build?

Is the image still building?
msg7193 (view) Author: guillem Date: 2018-06-05.11:01:58
Just a quick update on this. I have set up a repo with the appropriate Singularity configuration files and scripts:

https://github.com/gfrances/fast-downward


The repo is automatically monitored by Singularity Hub to rebuild all of the Singularity images upon new commits:

https://www.singularity-hub.org/collections/1067

Additionally, the repo is also monitored by Travis to test that all images are correctly built and can be run on a simple blocksworld 
instance under different Singularity versions:

https://travis-ci.com/gfrances/fast-downward

This is temporary and should be moved to the "official" aibasel Github account once we decide which revision we want to release and polish 
the remaining details. All of this assuming that we're quick enough before Microsoft takes over Github and forces all of the hosted code to 
be migrated to Visual C#, of course :-)
msg7134 (view) Author: guillem Date: 2018-05-11.17:33:32
Good point. Yes, that's similar to the Docker hub, which (if properly 
configured) 
builds the whole image on their servers each time you push some changes to the 
github 
repo (i.e. the repo where all container recipes, etc. live, NOT the main fast 
downward 
repo). It should be easy to automate the whole process so that creating a new 
fast-
downward tagged container equates to simply indicating which revision we want 
to create 
the image from.
msg7133 (view) Author: florian Date: 2018-05-11.17:27:48
While looking into Singularity for the IPC I came across https://singularity-hub.org
This is a registry of Singularity containers that is integrated with github. One
way to go would be to create a team account on github, add a repository and push
the Singularity script from issue770 into it (only the file, not the Fast
Downward source code). We could then register on singularity hub and connect the
accounts. The container would be build on their servers and people could use it
with something like

singularity run shub://aibasel/fast-downward

As far as I know, singularity hub supports branches and tags but I haven't
looked into it further. Docker has something analogous (https://hub.docker.com/)
but I know even less about it.
msg7131 (view) Author: guillem Date: 2018-05-11.17:18:11
This is a followup to issue770.

We'd like to provide a ready-made Fast Downward Singularity container which would allow (linux) 
end users to download and run the planner both locally and on cluster environments with one or two 
commands (plus of course the installation of singularity), without having to worry about 
dependencies.

Beyond the singularity recipes in themselves, which are simple and already in place from issue770, 
this issue should take care of:
- Discussing and implementing what exactly we want to include in the supoprted image(s).
- Discussing what kind of support / release cycle we provide for this.
- Automating and documenting the build process of the containers.
- Documenting the usage of the resulting containers, both locally and/or in cluster environments.
- Eventually deciding whether it would make sense to provide support for this within Lab 
experiments.
History
Date User Action Args
2018-11-26 12:15:00maltesetmessages: + msg8085
2018-11-26 12:13:59maltesetkeyword: + infrastructure
summary: See also the related issue787.
2018-06-05 11:56:18guillemsetmessages: + msg7197
2018-06-05 11:52:25floriansetmessages: + msg7196
2018-06-05 11:26:20guillemsetmessages: + msg7195
2018-06-05 11:22:25floriansetmessages: + msg7194
2018-06-05 11:01:58guillemsetstatus: chatting -> in-progress
messages: + msg7193
2018-05-14 18:26:04silvansetnosy: + silvan
2018-05-14 12:06:16cedricsetnosy: + cedric
2018-05-12 16:59:11jendriksetnosy: + jendrik
2018-05-11 17:33:32guillemsetmessages: + msg7134
2018-05-11 17:29:21maltesetnosy: + malte
2018-05-11 17:27:48floriansetstatus: unread -> chatting
messages: + msg7133
2018-05-11 17:18:49floriansetnosy: + florian
2018-05-11 17:18:11guillemcreate