EMBL-EBI is a world-leader in archiving and disseminating 3D biomacromolecular and cellular structure data. The EBI plays a key role in the dissemination of 3DEM data through the EMDB (emdb-empiar.org) and EMPIAR (empiar.org) public archives.
EMPIAR is expected to scale rapidly into the petabyte scale and in order to prepare for this eventuality we are undertaking a 2 year long internal ‘Imaging Archive’ pilot project with the aim of developing a scalable storage solution for the public archiving of big imaging data. The successful candidate will join the Software Development and Operations team (SDO) within the Technical Service Cluster (TSC), which is responsible for bringing new technology into the EBI to improve the service provided to internal and external users. The SDO team provides the large data archive (FIRE) that stores and serves a large proportion of the data provided by the EBI which will be adopted by EMDB and EMPIAR as part of this pilot project.
You will work as part of the FIRE sub-team within SDO, consisting of four engineers, who will be responsible for building and maintaining the large data archive. Examples of the projects include:
- Simplifying access to image data by implementing a REST API within FIRE that provides a subset of S3 like operations.
- Working to ensure FIRE can scale to meet the needs of the EMPIAR project through the design and implementation of a job processing system with high reliability that supports containerisation.
Qualifications and Experience
We are looking for a motivated Software Developer with Java, Python or comparable knowledge or experience comfortable developing on Linux/Unix and for Linux/Unix, or a track record of continuous learning.
They will have experience on performance tuning and optimizing their (and others) code, as well as working closely with other team member to identifying performance bottlenecks.
Required:
- Working knowledge with HTTP and APIs served via HTTP
- The ability to work with existing code bases and understanding existing architectures built on the code base
- Debugging production environments with standard Linux tools
- Being comfortable with database systems, contributing to the design databases
- Leveraging containerisation tools to test the system in an end-to-end manner in a continuous delivery fashion
- Familiarity with modern software development practices, version control (specifically git and related development models), code reviews, test coverage.
Desirable:
- A critical eye towards improving existing architectures without impacting existing use cases
- Previous experience with container orchestration and clustering technologies
- Experience with proprietary or open source object storage and data transfer technologies
You will be working in a DevOps environment, with projects managed using agile methodologies, and be willing to work as part of a team, taking care of some support issues alongside other team members.
by via developer jobs - Stack Overflow
No comments:
Post a Comment