Data Direct Networks

  • IME Intern

    Job Locations FR-MEUDON LA FORET
    Job Posted Date 7 months ago(7 months ago)
    Job ID
    2018-2154
  • Overview

    Data Encryption/Compression in IME

     

    DDN Storage is the world leader in high performance and massively scalable data management and storage solutions that accelerate business results and scientific insights for data-centric organizations worldwide. Our unified, end-to-end platform niquely addresses the tiered storage and large scale data management demands of mixed workloads, multiple collaborative data centres and Web and cloud environments. Across traditional and commercial high performance markets, customers rely on DDN Storage to solve the most demanding big data problems in industries such as cloud, online content and social networking, security and intelligence, life sciences, finance, energy and media production.

     

     

    DDN’s Infinite Memory Engine (IME) is a scale-out, software-defined, flash storage platform that streamlines the data path for application I/O. IME interfaces directly to applications and secures I/O via a data path that eliminates file system bottlenecks.

     

     

    Mission

     

    As part of the development of a new generation of Burst Buffer technologies, DDN needs to study in details the impact on performance of data encryption and compression in the IME product. The goal of this internship is to implement a proof of concept (POC) and evaluate performances of chosen solutions with various workload patterns. Since IME is focusing on performance, encryption and compression should have low overhead (low resource usage and high speed).

     

    The internship will start with a learning period on encryption and compression algorithms in High Performance Computing (HPC) context. The next step will be to develop prototypes and benchmark selected algorithms. Finally, a POC will be implemented on the top of IME to allow evaluations with realistic workloads.

     

    The internship will allow to understand how a software solution is benchmarked, setting up a performance test environment and providing a basic performance analysis. DDN R&D team will be providing support all along the way.

     

     

    The mission will consist of the following steps:

    • Study related work on fast data compression and encryption algorithms.
    • Provide a survey on a few relevant solutions.
    • Implement micro-benchmarks for the selected algorithms.
    • Measure performance and efficiency of these solutions.
    • Implement a POC on the top of IME.
    • Performance evaluations with IO benchmarks and realistic workloads.
    • Find pros and cons, list pitfalls of a solution directly integrated into IME.
    • Bonus: Evaluate potential performance gain with hardware accelerators

     

     

    Diplomas / Training

     

    Minimum 3rd year of an engineering school, Master 1 Computer Science

     

     

    Required skills

    - C development

    - UNIX / Linux environment

     

     

    Skills / Qualities appreciated

    Know some data encryption/compression algorithms

    - Attended classes in Network Security

    - Experience in a High Performance Computing project  

     

    Start date: As soon as possible

     

    Duration: 6 months

    Options

    Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
    Share on your newsfeed