Since the group is focused on physics research, other people that come after I leave may not have the necessary skills for maintaining the server. On the other hand, I am a post-doc and may need to leave the group at any moment in favor of a permanent position. We do not deal with personal information and leaks or data loss would have only minor consequences. However, the data stored does not contain sensitive information. Ideally, I should be able to even read the data from within the server with the service running, since we may do some data analysis inside this computer.Ĭomment about point 2: I know not performing regular updates may leave security holes. it will not be compacted in a binary blob where you need the server running to retrieve it. In the case it breaks, will the data be stored in a way someone can easily retrieve, i.e.setup once and, as long no one updates the OS, it should not break (see comment below). You dont have to set up git-annex on a separate server or add annex remotes to the repository. If I must deploy GitLab's CE, how hard is to maintain such a server? My ideal scenario is a zero maintenance, i.e. By integrating git-annex into GitLab it becomes much easier and safer to use.Git was initially designed and developed by Linus Torvalds for Linux kernel development in 2005, and has since become the most widely adopted version control system.
Git annex gitlab code#
However, this seems that it will upload the files to GitLab's server, defeating the whole purpose of a storage computer (also, we would need to buy storage from them). So, it would make sense to create a "data" repository where most of the files will be binary ones, stored and tracked via lfs. We already use GitLab (the cloud version) to version control our codes and easily share them between us.
Gitlab-CI is an amazing platform that makes CI pipelines simple and easy. When researching the best way to do this, I came across git lfs. Nathan will talk about Datalad and Git Annex to members of PenguinsUnbound. As such, I needed to think the best way to organize the data we will be generating. I am part of a small physics research team (10-15 people) which recently has acquired a storage server and I will be responsible for setting it up.
0 kommentar(er)
