Open-Set Object Detection: Can VLM understand all of the unknown world? H/F

Job title:

Open-Set Object Detection: Can VLM understand all of the unknown world? H/F

Company:

Commissariat à l’Énergie Atomique

Job description

Organisation The French Alternative Energies and Atomic Energy Commission (CEA) is a key player in research, development and innovation in four main areas :

• defence and security,
• nuclear energy (fission and fusion),
• technological research for industry,
• fundamental research in the physical sciences and life sciences.

Drawing on its widely acknowledged expertise, and thanks to its 16000 technicians, engineers, researchers and staff, the CEA actively participates in collaborative projects with a large number of academic and industrial partners.The CEA is established in ten centers spread throughout FranceReference 2024-33175Description de l’unitéBased in Saclay (Essonne), the LIST is one of the two institutes of CEA Tech, the Technological Research Division of the CEA. Dedicated to intelligent digital systems, its mission is to carry out technological developments of excellence on behalf of industrialpartners, in order to create value. Within the LIST, the Laboratory of Vision and Learning for Scene Analysis (LVA) conducts its research in the field of computer visionand artificial intelligence for the perception of intelligent and autonomous systems. The laboratory’s research themes include visual recognition, behavior and activity analysis, large-scale automatic annotation, and perception and decision models.Position descriptionCategoryMathematics, information, scientific, softwareContractInternshipJob titleOpen-Set Object Detection: Can VLM understand all of the unknown world? H/FSubjectDeep learning models have demonstrated significant success to detect a close set of known annotated classes seen during training. But, how will they behave when facing up to objects of unknown classes?
As their behaviour is uncertain when subjected to never-before-seen classes, we aim to develop robust Open Set ObjectDetectors (OSOD), able to localise and classify any objects, no matter their classes are known or unknown during training.
It is of paramount importance to ensure safe deployment of AI models as trustable AI is crucial in critical applications such as autonomous driving. Indeed, one of the most important issues for these applications is the lack of supervisory signals on data notseen in training, which can generate erroneous yet confident predictions on out-of-distribution (OOD) data.Contract duration (months)6Job descriptionYour missions within this internship are to:

• Study state-of-the-art methods of Open Set Object Detection (OSOD) as well as Visual Language Models (VLM) in the context of Open World containing both known and unknown objects;

• Design an object detector aware of the existence of the unknown;

• Evaluate the proposed method on recent OSOD benchmarks and compare to the state of the art;

• Challenge these methods by applying them to new contexts (e.g. aerial images);

• If relevant, submit your contributions to an international conference or workshop for publication.

Methods / MeansComputer vision, deep learning, VLM, pytorchApplicant ProfileJoin CEA List and LVA as an intern to:

• Work in one of the most innovative research organizations in the world, addressing societal challenges to build the world of tomorrow

• Discover a rich ecosystem: privileged connections between the industrial and academic sectors

• Conduct research autonomously and creatively: encouragement to valorize results (scientific articles, patents, open-source codes…)

• Join a young and dynamic team

• Benefit from an internal computing infrastructure with more than 300 state-of-the-art GPUs

• Receive a stipend between €1300 and €1400 per month

• Have the opportunity to continue with a PhD or as aresearch engineer after the internship

• Have the possibility of remote work, receive a 75% reimbursement on public transportation costs, and benefitfrom the “mobili-jeune”aid to reduce rent costs..

In line with CEA’s commitment to integrating people with disabilities, this job is open to all.Position locationSiteSaclayJob locationFrance, Ile-de-France, Essonne (91)LocationPalaiseauCandidate criteriaPrepared diplomaBac+5 – Master of ScienceRecommended trainingMaster / école d’ingénieur en computer vision / AIPhD opportunityOuiRequesterPosition start date01/02/2025

Expected salary

€1300 – 1400 per month

Location

Essonne

Job date

Sat, 28 Sep 2024 00:18:48 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesineu.com) you saw this job posting.