In the framework of the PEPR Santé numérique “Autonom-Health” project (Health, behaviors and autonomous digital technologies), the speech and language research group at the Computer Science Lab in Bordeaux, France (LaBRI) and the LORIA (Nancy, France) are looking for candidates for a fully funded PhD position (36 months).  

Top

Open faculty position at KU Leuven, Belgium: junior professor in Synergistic Processing
of Multisensory Data for Audio-Visual Understanding

KU Leuven's Faculty of Engineering Science has an open position for a junior professor
(tenure track) in the area of audiovisual understanding. The successful candidate will
conduct research on synergetic processing of multisensory data for audio-visual
understanding, teach courses in the Master of Engineering Science and supervise students
in the Master and PhD programs. The candidate will be embedded in the PSI research
division of the Department of Electrical Engineering. More information is available at
https://www.kuleuven.be/personeel/jobsite/jobs/60193566?hl=en&lang=en . The deadline for
applications is September 29, 2023.

KU Leuven is committed to creating a diverse environment. It explicitly encourages
candidates from groups that are currently underrepresented at the university to submit
their applications.

Top

PhD in ML/NLP – Fairness and self-supervised learning for speech processing
Starting date: October 1st, 2023 (flexible)
Application deadline: June 9th, 2023
Interviews (tentative): June 14th, 2023

Salary: ~2000€ gross/month (social security included)

Mission: research oriented (teaching possible but not mandatory)

Keywords: speech processing, fairness, bias, self-supervised learning, evaluation metrics 

CONTEXT

This thesis is in the context of the ANR project E-SSL (Efficient Self-Supervised Learning for Inclusive and Innovative Speech Technologies). Self-supervised learning (SSL) has recently emerged as one of the most promising artificial intelligence (AI) methods as it becomes now feasible to take advantage of the colossal amounts of existing unlabeled data to significantly improve the performances of various speech processing tasks.

PROJECT OBJECTIVES

Speech technologies are widely used in our daily life and are expanding the scope of our action, with decision-making systems, including in critical areas such as health or legal aspects. In these societal applications, the question of the use of these tools raises the issue of the possible discrimination of people according to criteria for which society requires equal treatment, such as gender, origin, religion or disability...  Recently, the machine learning community has been confronted with the need to work on the possible biases of algorithms, and many works have shown that the search for the best performance is not the only goal to pursue [1]. For instance, recent evaluations of ASR systems have shown that performances can vary according to the gender but these variations depend both on  data used for learning and on models [2]. Therefore such systems are increasingly scrutinized for being biased while trustworthy speech technologies definitely represents a crucial expectation.

 Both the question of bias and the concept of fairness have now become important aspects of AI, and we now have to find the right threshold between accuracy and the measure of fairness. Unfortunately, these notions of fairness and bias are challenging to define and their
 meanings can greatly differ [3].

 The goals of this PhD position are threefold:

- First make a survey on the many definitions of robustness, fairness and bias with the aim of coming up with definitions and metrics fit for speech SSL models

- Then gather speech datasets with high amount of well-described metadata

- Setup an evaluation protocol for SSL models and analyzing the results.

SKILLS

• Master 2 in Natural Language Processing, Speech Processing, computer science or data science.

• Good mastering of Python programming and deep learning framework.

• Previous experience in bias in machine learning would be a plus

• Very good communication skills in English

• Good command of French would be a plus but is not mandatory 

SCIENTIFIC ENVIRONMENT

The PhD position will be co-supervised by Alexandre Allauzen (Dauphine Université PSL, Paris) and Solange Rossato and François Portet (Université Grenoble Alpes). Joint meetings are planned on a regular basis and the student is expected to spend time in both places. Moreover, two other PhD positions are open in this project.  The students, along with the partners will closely collaborate. For instance, specific SSL models along with evaluation criteria will be developed by the other PhD students. Moreover, the PhD student will collaborate with several team members involved in the project in particular the two other PhD candidates who will be recruited  and the partners from LIA, LIG and Dauphine Université PSL, Paris. The means to carry out the PhD will be provided both in terms of missions in France and abroad and in terms of equipment. The candidate will have access to the cluster of GPUs of both the LIG and Dauphine Université PSL. Furthermore, access to the National supercomputer Jean-Zay will enable to run large scale experiments.

INSTRUCTIONS FOR APPLYING

Applications must contain: CV + letter/message of motivation + master notes + be ready to provide letter(s) of recommendation; and be addressed to Alexandre Allauzen (alexandre.allauzen@espci.psl.eu), Solange Rossato (Solange.Rossato@imag.fr) and François Portet (francois.Portet@imag.fr). We celebrate diversity and are committed to creating an inclusive environment for all employees.

REFERENCES:

[1] Mengesha, Z., Heldreth, C., Lahav, M., Sublewski, J. & Tuennerman, E. “I don’t Think These Devices are Very Culturally Sensitive.”—Impact of Automated Speech Recognition Errors on African Americans. Frontiers in Artificial Intelligence 4. issn: 2624-8212. https://www.frontiersin.org/article/10.3389/frai.2021.725911 (2021).

[2] Garnerin, M., Rossato, S. & Besacier, L. Investigating the Impact  of Gender Representation in ASR Training Data: a Case Study on Librispeech in Proceedings of the 3rd Workshop on Gender Bias in Natural Language Processing (2021), 86–92.
[3] Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K. & Galstyan, A. A Survey on Bias and Fairness in Machine Learning.  ACMComput. Surv. 54. issn: 0360-0300. https://doi.org/10.1145/3457607 (July 2021).

Top

In the framework of the European FETPROACT « Fvllmonti » project and the PEPR Santé numérique “Autonom-Health” project, the speech and language research group at the Computer Science Lab in Bordeaux, France (LaBRI) is looking for candidates for a 24-months post-doctoral position. 

Top

ELDA (Evaluations and Language resources Disctribution Agency) looks for full/part time transcriptors for transcription of phone calls in the financial domain.

Location: ELDA (Paris-France)

Latest starting date: July 2023

Languages and mission details

• German - 21h of speech to be transcribed + phonetisation task;
• Spanish - 1h of speech to be transcribed;
• Italian - 1h of speech to be transcribed;
• Japanese - 21h of speech to transcribe + phonetisation task;
• Polish - number of hours vary as it is still being tested.

Profile

• Native expertise in the selected language with a very good level of spelling and grammar;
• Good knowledge of French and/or English;
• Good computer skills;
• Ability to integrate and scrupulously follow transcription rules.

Salary and duration

• Starting from SMIC depending on skills;
• Approximately 3 months (FT for the longer assignments).

Application

• Send your CV to <lucille@elda.org> ou <gabriele@elda.org>;
• Include [Transcription *language*] in the object field.

Top

DRhyaDS

A new framework for understanding the Dynamic Rhythms and Decoding of Speech

Job Title - Postdoctoral Researcher

Disciplines and Areas of Research - Speech science, Psycholinguistics, Psychoacoustics

Contract Duration - 1 Year

Research Overview: The DRhyaDS project aims to develop a new framework for understanding the dynamic rhythms and decoding of speech. It focuses on exploring the temporal properties of speech and their contribution to speech perception. The project challenges the conventional view that speech rhythm perception relies on a one-to-one association between specific modulation frequencies in the speech signal and linguistic units. One of the key objectives of the project is to investigate the impact of language-specific temporal characteristics on speech dynamics. The project team will analyze two corpora of semi-spontaneous speech data from French and German, representing syllable-timed and stress-timed languages, respectively. Various acoustic analyses will be conducted on these speech corpora to explore the variability of slow temporal modulations in speech at an individual level. This comprehensive acoustic exploration will involve extracting and analyzing prosody, spectral properties, temporal dynamics, and rhythmic patterns. By examining these acoustic parameters, the project aims to uncover intricate details about the structure and variation of speech signals across languages and speakers, contributing to a more nuanced understanding of the dynamic nature of spoken language and its role in human communication. Environment: The selected candidate will be an integral part of an international research team and will work in a collaborative and stimulating lab environment. The project brings together a FrancoGerman team of experts in linguistics, psychoacoustics and cognitive neuroscience, led by Dr. Léo Varnet (CNRS, ENS Paris) and Dr. Alessandro Tavano (Max Planck Institute, Goethe University Frankfurt). The successful candidate will work under the supervision of Dr Léo Varnet, at the Laboratoire des Systèmes Perceptifs (ENS Paris).

Job description: This is a one-year postdoctoral contract position, offering a net salary in accordance with French legislation (~2500€/month + social and medical benefits). Women and minorities are strongly encouraged to apply. The successful candidate will participate in research activities, collaborate with team members, and contribute to scientific publications and communications. Additionally, they will have the autonomy to suggest and implement their own analysis techniques and approaches. Their responsibilities will include: - Taking a lead role in collecting a comprehensive corpus of French speech data, adhering to a rigorous data collection protocol - Collaborating closely with the German team to leverage the existing German speech corpus for comparative analysis and cross-linguistic investigations - Conducting in-depth acoustic analysis of the corpora, employing advanced techniques to investigate the variability and dynamics of slow temporal modulations in speech - Actively participating in team meetings, workshops, and conferences to present research progress, exchange ideas, and contribute to the intellectual growth of the project - Engaging in science outreach activities to promote the project's research outcomes and facilitate public understanding of speech perception and language processing.

Qualifications: - A recently obtained PhD in a relevant field (e.g., linguistics, psychology, neuroscience, computational sciences) - Strong expertise in linguistics, speech perception, acoustic analysis, and statistical methods - Proficiency in programming languages commonly used in speech research. Knowledge of MATLAB would be particularly valuable for data processing and analysis within the project. - Strong written and verbal communication skills in English. Candidates with proficiency in French and/or German language skills would be particularly appreciated, as it would enable a deeper understanding of the linguistic characteristics of the respective corpora.

Application process To apply for this position, please submit a CV and a cover letter (in French or English) along with the names and contact information of 2 referees to Léo Varnet (leo.varnet@cnrs.fr). The application deadline is 31th July 2023. Interviews will be conducted in September. The ideal start date is October-November 2023, with some flexibility allowed. Feel free to get in touch informally to discuss this position

Top

Inria is opening a fully funded PhD position on multimodal speech
anonymization. For details and to apply, see:
https://jobs.inria.fr/public/classic/en/offres/2023-06410

Applications will be reviewed on a continuous basis until July 2.

Top

Call for postdoc applications in Natural Language Processing for the automatic detection of gender stereotypes in the French media (Grenoble Alps University, France)

Starting date:                flexible,  November 30, 2023, at the latest

Duration:                       full-time position for 12 months

Salary:                         according to experience (up to 4142€/ month)

Application Deadline: Open until filled

Location:               The position will be based in Grenoble, France. This is not a remote work.

Keywords:             natural language processing, gender stereotypes                                 bias, corpus analysis, language models, transfer                                 learning, deep learning

*Context* The University of Grenoble Alps (UGA) has an open position for a highly motivated postdoc researcher to joint the multidisciplinary GenderedNews project. Natural Language Processing models trained on large amount of on-line content, have quickly opened new perspectives to process on-line large amount of on-line content for measuring gender bias in a daily basis (see our project https://gendered-news.imag.fr/ ). Regarding research on stereotypes, most recent works have studied Language Models (LM) from a stereotype perspective by providing specific corpora such as StereoSet (Nadeem et al., 2020) or CrowS-Pairs (Nangia et al. 2020). However, these studies are focusing on the quantifying of bias in the LM predictions rather than bias in the original data (Choenni et al., 2021). Furthermore, most of these studies ignore named entities (Deshpande et al., 2022) which account for an important part of the referents and speakers in news. In this project, we intend to build corpora, methods and NLP tools to qualify the differences between the language used to describe groups of people in French news.

*Main Tasks*

The successful postdoc will be responsible for day-to-day running of the research project, under the supervision of François Portet (Prof UGA at LIG) and Gilles Bastin (prof UGA at PACTE). Regular meetings will take place every two weeks.

- Defining the dimensions of stereotypes to be investigated and the possible metrics that can be processed from a machine learning perspective.

- Exploring, managing and curating news corpora in French for stereotypes investigation, with a view to making them widely available to the community to favor reproducible research and comparison.

- Studying and developing new computational models to process large number of texts to reveal stereotype bias in news. Make use of pretrained models for the task.

- Evaluate the methods on curated focused corpus and apply it to the unseen real longitudinal corpus and analyze the results with the team.

- Preparing articles for submission to peer-reviewed conferences and journals.

- Organizing progress meetings and liaising between members of the team. 

The hired person will interact with PhD students, interns and researchers being part of the GenderedNews project. According to his/her background his/her own interests and in accordance with the project's objective, the hired person will have the possibility to orient the research in different directions.

*Scientific Environment*

The recruited person will be hosted within the GETALP teams of the LIG laboratory (https://lig-getalp.imag.fr/), which offers a dynamic, international, and stimulating environment for conducting high-level multidisciplinary research. The person will have access to large datasets of French news, GPU servers, to support for missions as well as to the scientific activities of the labs. The team is housed in a modern building (IMAG) located in a 175-hectare landscaped campus that was ranked as the eighth most beautiful campus in Europe by the Times Higher Education magazine in 2018.

The person will also closely work with Gilles Bastin (PACTE, a Sociology lab in Grenoble) and Ange Richard (PhD at LIG and PACTE). The project also includes an informal collaboration with 'Prenons la une' (https://prenonslaune.fr/) a journalists’ association which promotes a fair representation of women in the media.

*Requirements*

The candidate must have a PhD degree in Natural Language Processing or computer science or in the process of acquiring it. The successful candidate should have

-  Good knowledge of Natural Language Processing -  Experience in corpus collection/formatting and manipulation. -  Good programming skills in Python -  Publication record in a close field of research -  Willing to work in multidisciplinary and international teams -  Good communication skills -  Good mastering of French is required

*Instructions for applying*

Applications will be considered on the fly and must be addressed to François Portet (Francois.Portet@imag.fr). It is therefore advisable to apply as soon as possible. The application file should contain

-   Curriculum vitae -   References for potential letter(s) of recommendation -   One-page summary of research background and interests for the position -   Publications demonstrating expertise in the aforementioned areas -   Pre-defense reports and defense minutes; or summary of the thesis with the date of defense for those currently in doctoral studies

*References*

Deshpande et al. (2022). StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes. arXiv preprint arXiv:2205.14036.

Choenni et al. (2021). Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you? arXiv preprint arXiv:2109.10052.

Nadeem et al. (2020) StereoSet: Measuring stereotypical bias in pretrained language models. ArXiv.

Nangia et al. (2020) CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models. In EMNLP2020.

Top

the new Postdoc-Kolleg 'Education and AI in the 21st century.

Technology-enabled innovations in subject-specific teaching

settings (PostdocTEIFUN)' of the Tübingen School of Education (TüSE)

and Professional School of Education Stuttgart-Ludwigsburg (PSE) will

start in 2024.

It is offering six Post-doc positions funded for six years (100% TVL

E14) to conduct interdisciplinary research in the field of education

and AI.

The official announcement can be found here:

https://uni-tuebingen.de/universitaet/stellenangebote/newsfullview-stellenangebote/article/6-akademische-ratsstellen-m-w-d-e-14-tv-l-100/

Among the various potential research fields, the following could be of

interest here:

'Development of didactically informed Intelligent Language Tutoring

approaches targeting spoken language learning for the English

classroom. Potential directions include but are not limited to the

realization of perceptual training, input enhancement, automatic

corrective feedback, or prosodic complexity analysis.'

Interested? Please contact us at:

Sabine Zerbian, sabine.zerbian@ifla.uni-stuttgart.de

Detmar Meurers, detmar.meurers@uni-tuebingen.de

Note that there is a tight deadline for applications: 30.06.2023

Top

In a joint research project *VidQA*, our collaboration partner from University of Applied Sciences (Prof. Christian Wartena, HsH Hochschule Hannover) offers a full position (three years, as soon as possible) for a PhD student:

*VidQA* is a joint research project of the Institute for Applied Data Science Hannover (DATA|H) of the HsH, the Research Center L3S of the Leibniz University and the TIB – Leibniz Information Centre for Science and Technology. The goal of the project is the development and evaluation of new methods for semi-automatic generation of questions and answers for learning videos. Here, we pursue several research questions, such as, among others, the aspect of multimodality of video-based learning media, the generation of distractors ('wrong answers') for multiple-choice questions, and the automatic evaluation of answers for open-ended question formats.

*What you can expect*:

-  Develop and implement procedures for generating (multiple choice) questions, answers, and distractors.

-  Development and implementation of procedures for scoring free text answers

-  Collaboration in the development and evaluation of a system for examing comprehension of learning videos

-  Publication of research and development results at conferences and in professional journals

-  Participation in the organization the project

*Requirements*

Research Field: Computer science

Education Level: Master Degree or equivalent

Skills/Qualifications

-  Master's degree (or equivalent) in computer science or computational linguistics

-  In-depth knowledge in the field of artificial intelligence and machine learning

-  Proven knowledge in Natural Language Processing (NLP)

-  Gender and diversity skills

Languages:     ENGLISH

Level:     Excellent

Languages:    GERMAN

Level:     Good

Website for additional job details: https://karriere.hs-hannover.de/bewerbung/beschreibung-900000104-10057.html

Where to apply: https://karriere.hs-hannover.de/bewerbung/beschreibung-900000104-10057.html

*First Contact*

************************************

Prof. Dr. Christian Wartena

University of Applied Sciences (HsH Hochschule Hannover)

Institute for Applied Data Science Hannover (DATA|H)

E-Mail: christian.wartena@hs-hannover.de

Postal address

City:    Hannover

Website:     https://www.hs-hannover.de/forschung/forschungsaktivitaeten/forschungscluster/smart-data-analytics

Street:     Expo Plaza 12

Postal Code:     30539

Top

Pour plus d'informations voir :
https://emploi.cnrs.fr/Offres/Doctorant/UMR7020-RICMAR-001/Default.aspx

Pour candidater remplissez le formulaire suivant : https://forms.gle/DdaV8BhN3E4DuXnA8

La date de clôture à candidatures est le 10 juillet 2023.

Top

Ingénieur chef de projet ressources et technologies linguistiques
 
Centre Inria : CRI Nancy - Grand Est 

Top

Call for postdoc applications in Natural Language Processing for the automatic detection of gender stereotypes in the French media (Grenoble Alps University, France)

Starting date:                flexible,  November 30, 2023, at the latest

Duration:                       full-time position for 12 months

Salary:                         according to experience (up to 4142€/ month)

Application Deadline: Open until filled

Location:               The position will be based in Grenoble, France. This is not a remote work.

Keywords:             natural language processing, gender stereotypes                                 bias, corpus analysis, language models, transfer                                 learning, deep learning

*Context* The University of Grenoble Alps (UGA) has an open position for a highly motivated postdoc researcher to joint the multidisciplinary GenderedNews project. Natural Language Processing models trained on large amount of on-line content, have quickly opened new perspectives to process on-line large amount of on-line content for measuring gender bias in a daily basis (see our project https://gendered-news.imag.fr/ ). Regarding research on stereotypes, most recent works have studied Language Models (LM) from a stereotype perspective by providing specific corpora such as StereoSet (Nadeem et al., 2020) or CrowS-Pairs (Nangia et al. 2020). However, these studies are focusing on the quantifying of bias in the LM predictions rather than bias in the original data (Choenni et al., 2021). Furthermore, most of these studies ignore named entities (Deshpande et al., 2022) which account for an important part of the referents and speakers in news. In this project, we intend to build corpora, methods and NLP tools to qualify the differences between the language used to describe groups of people in French news.

*Main Tasks*

The successful postdoc will be responsible for day-to-day running of the research project, under the supervision of François Portet (Prof UGA at LIG) and Gilles Bastin (prof UGA at PACTE). Regular meetings will take place every two weeks.

- Defining the dimensions of stereotypes to be investigated and the possible metrics that can be processed from a machine learning perspective.

- Exploring, managing and curating news corpora in French for stereotypes investigation, with a view to making them widely available to the community to favor reproducible research and comparison.

- Studying and developing new computational models to process large number of texts to reveal stereotype bias in news. Make use of pretrained models for the task.

- Evaluate the methods on curated focused corpus and apply it to the unseen real longitudinal corpus and analyze the results with the team.

- Preparing articles for submission to peer-reviewed conferences and journals.

- Organizing progress meetings and liaising between members of the team. 

The hired person will interact with PhD students, interns and researchers being part of the GenderedNews project. According to his/her background his/her own interests and in accordance with the project's objective, the hired person will have the possibility to orient the research in different directions.

*Scientific Environment*

The recruited person will be hosted within the GETALP teams of the LIG laboratory (https://lig-getalp.imag.fr/), which offers a dynamic, international, and stimulating environment for conducting high-level multidisciplinary research. The person will have access to large datasets of French news, GPU servers, to support for missions as well as to the scientific activities of the labs. The team is housed in a modern building (IMAG) located in a 175-hectare landscaped campus that was ranked as the eighth most beautiful campus in Europe by the Times Higher Education magazine in 2018.

The person will also closely work with Gilles Bastin (PACTE, a Sociology lab in Grenoble) and Ange Richard (PhD at LIG and PACTE). The project also includes an informal collaboration with 'Prenons la une' (https://prenonslaune.fr/) a journalists’ association which promotes a fair representation of women in the media.

*Requirements*

The candidate must have a PhD degree in Natural Language Processing or computer science or in the process of acquiring it. The successful candidate should have

-  Good knowledge of Natural Language Processing -  Experience in corpus collection/formatting and manipulation. -  Good programming skills in Python -  Publication record in a close field of research -  Willing to work in multidisciplinary and international teams -  Good communication skills -  Good mastering of French is required

*Instructions for applying*

Applications will be considered on the fly and must be addressed to François Portet (Francois.Portet@imag.fr). It is therefore advisable to apply as soon as possible. The application file should contain

-   Curriculum vitae -   References for potential letter(s) of recommendation -   One-page summary of research background and interests for the position -   Publications demonstrating expertise in the aforementioned areas -   Pre-defense reports and defense minutes; or summary of the thesis with the date of defense for those currently in doctoral studies

*References*

Deshpande et al. (2022). StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes. arXiv preprint arXiv:2205.14036.

Choenni et al. (2021). Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you? arXiv preprint arXiv:2109.10052.

Nadeem et al. (2020) StereoSet: Measuring stereotypical bias in pretrained language models. ArXiv.

Nangia et al. (2020) CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models. In EMNLP2020.

Top

The Evaluations and Language resources Distribution Agency (ELDA), a company specialized in Human Language Technologies within an international context is currently seeking to fill an immediate vacancy for the permanent position: Project Manager - Intellectual Property, Personal Data Protection for AI and Language Technologies.

Job description

Under the CEO’s supervision, the Project Manager will handle legal issues related to the compilation, use and distribution of language datasets in a European and international environment. This yields excellent opportunities for creative, and motivated candidates wishing to participate actively in the Language Engineering field.

Their main tasks will consist of:

• Analysing the legal status of language datasets and language models;
• Implementing data protection requirements in the processing and distribution of language data;
• Analysing data collection legal issues;
• Drafting and negotiating distribution contracts for language datasets to be added to an online catalogue;
• Implementing evaluation procedures for IPR clearance of digital data;
• Assessing ethical practices within our activities.

The position is based in Paris.

Salary: Commensurate with qualifications and experience (between 40-60K€).

Other benefits: complementary health insurance and meal vouchers.

Required profile:

• PhD (or Master’s degree + at least 3 years’ experience) in IT Law, with good understanding of intellectual property and data protection;
• Fluent English, with advanced writing and analytical skills;
• Experience implementing data protection regulations;
• Knowledge of the European digital regulatory environment (eg. Digital Services Act, Digital Market Act, Data Act, Digital Governance Act, Open Data Directive, AI Act);
• Familiar with public licensing schemes (CC, GPL, etc.); 
• Involvement in European or international projects related to IPR and other legal aspects;
• Dynamic, communicative, flexible and capable of working independently as well as in a team;
• EU citizen, or residence permit enabling to work in France.

About

ELDA is an SME established in 1995 to promote the development and exploitation of Language Resources (LRs). Language Resources include all data necessary for language engineering, such as monolingual and multilingual lexica, text corpora, speech databases and terminology. ELDA’s role is to produce LRs, to collect and to validate them and, foremost, make them available to users in compliance with applicable regulations and ethical requirements.

For further information about ELDA, visit: http://www.elda.org  

Applicants should email a cover letter addressing the points listed above together with a curriculum vitae to:

ELDA
9 rue des Cordelières
75013 Paris
FRANCE
Email: job@elda.org

Top

The Signal Processing and Speech Communication Laboratory (https://www.spsc.tugraz.at) of
Graz University of Technology (TU Graz) is looking for

    2 Research and Teaching Associates
            – PhD Positions –
    in Signal Processing and Speech Communication

with appointments planned for November 2023.

Both associates are expected to perform excellent research towards a PhD degree (often in cooperation with international partners) under the guidance of professors Gernot Kubin and Barbara Schuppler. Furthermore, the associates will co-advise Bachelor’s and Master’s student projects and develop and teach laboratory and problem classes on various aspects of signal processing. Fluency in English is a must, knowledge of German is an asset. A strong background in signal processing and/or speech communication as well as an excellent Master’s degree in Electrical Engineering, Information Engineering, or similar are required.

Entry-level gross yearly salaries are about EUR 45.900,- for 40 hrs per week and initial contract durations may span up to 4 years.

The Signal Processing and Speech Communication Laboratory was the main organizer of INTERSPEECH 2019 in Graz (https://www.interspeech2019.org) and takes the lead in building a Graduate School of Excellence in European Speech and Language Technologies together with seven partners of the Unite! University Alliance (https://www.unite-university.eu). TU Graz is ranked #2 of all universities in the German speaking countries (https://www.umultirank.org).

Graz (https://www.graztourismus.at/en) is the second largest city of Austria located in the south-eastern province of Styria at the cross-roads of major continental European cultures. It enjoys a vibrant student life with eight universities and excellent leisure and sports opportunities in the larger Alps-Adriatic region. UNESCO has included the historic centre of Graz in its World Heritage List and Graz has been a Cultural Capital of Europe.

For further information, please contact the two advisors
Gernot Kubin at gernot.kubin@tugraz.at  and Barbara Schuppler at b.schuppler@tugraz.at.

Applications are due by September 27, 2023, and must be submitted electronically at
https://jobs.tugraz.at/en/jobs/b645ee47-c3aa-712a-29b3-64d61edea5e6.

Top

Job Offer: PhD Self-supervised models for transcribing the spontaneous speech of for 3- to 6-year-old children in French

Starting date: between October 1st and December 1st, 2023 (flexible) Application deadline: From now until the position is filled Interviews: from September or latter if the position is still open

Salary: ~2000€ gross/month (social security included)

Mission: research oriented (teaching possible but not mandatory)

Place of work: Laboratoire d'Informatique de Grenoble, CNRS, Grenoble,France

Keywords: deep learning, natural language processing, speech recognition for children's voices, documentation of language development

Description As part of the Artificial Intelligence & Language Chair at the Multidisciplinary Institute in Artificial Intelligence (; https://miai.univ-grenoble-alpes.fr/research/chairs/perception-interaction/artificialintelligence-language-850480.kjsp?RH=6499588038450843), we offer a PhD thesis topic devoted to the enriched automatic transcription of the spontaneous speech of 3- to 6-year-old children using an architecture based on self-supervised models [1]. These methods have emerged as one of the most successful approaches in artificial intelligence (AI), as they allow to exploit a colossal amount of existing unlabeled data and so achieve significantly higher performance for many domains. As part of the DyLNet project (Language dynamics, linguistic learning, and sociability at preschool: benefits of wireless proximity sensors in collecting big data ; https://dylnet.univ-grenoblealpes.fr/), coordinated by A. Nardy, a children's speech collection was carried out in a socially mixed preschool over a period of 2 and a half years [2]. Each year, around 100 children wore a box fitted with microphones that continuously recorded their speech. These boxes were worn for one week a month. We thus collected ~ 30,000 hours of recordings, 815 of which were transcribed and annotated by linguists. This unprecedentedly large corpus of children's spoken French will enable to meet the technical challenges associated with automatic speech processing. While continuous and unsupervised collection methods are now available, another challenge is the automatic transcription of children's voices, made difficult by their acoustic characteristics. The aim of the thesis is to design a transcription system for researchers as well as child development professionals (teachers, speech therapists, etc.). The aim of the thesis is therefore to: - review the state-of-the-art models and the performances achieved by automatic transcription tools for children's voices - implement processes to exploit the mass of audio data collected, and the associated metadata (sociodemographic information on participants, contexts of enunciation, interlocutors, etc.). - design and develop a system for transcribing children's speech using self-supervised tools, as proposed by Speechbrain [3]. The best system obtained will be made available to the language acquisition research community and child development professionals. - set up a system evaluation protocol based on transcribed data - propose tools for automating some of the linguistic analyses to enrich the obtained transcriptions and document oral language development in 3- to 6-year-old children. Skills : Master degree in Computer Science, Artificial Intelligence or Data Science Mastering Python programming and deep learning frameworks. Experience in automatic natural language processing will be really appreciated Excellent communication skills in French or, failing that, in English Scientific environment : The PhD. position will be co-supervised by Benjamin Lecouteux, Solange Rossato (LIG, Univ. Grenoble Alpes) et Aurélie Nardy (Lidilem, Univ. Grenoble Alpes). The recruited person will be part of the GETALP team of the LIG laboratory (https://lig-getalp.imag.fr/) which has extensive expertise and experience in the field of Natural Language Processing. The GETALP team offers a stimulating, multinational working environment, and provides the resources needed to complete the thesis in terms of equipment and scientific exchanges. Regular meetings with the three supervisors will take place throughout the thesis.

Instructions for applying Application forms must contain: CV + letter/message of motivation + master + notes + be ready to provide letter(s) of recommendation. They should be addressed to Benjamin Lecouteux (benjamin.lecouteux@univ-grenoble-alpes.fr), Solange Rossato (solange.rossato@univ-grenoble-alpes.fr) and Aurélie Nardy (aurelie.nardy@univ-grenoblealpes.fr).

[1] Evain, S., Nguyen, H., Le, H., Boito, M. Z., Mdhaffar, S., Alisamir, S., ... & Besacier, L. (2021). Lebenchmark: A reproducible framework for assessing self-supervised representation learning from speech. https://doi.org/10.48550/arXiv.2104.11462

[2] Nardy, A., Bouchet, H., Rousset, I., Liégeois, L., Buson, L., Dugua, C., Chevrot, J.-P. (2021). Variation sociolinguistique et réseau social : constitution et traitement d’un corpus de données orales massives. Corpus, 22 [en ligne]. https://doi.org/10.4000/corpus.5561

[3] Ravanelli, M., Parcollet, T., Plantinga, P., Rouhe, A., Cornell, S., Lugosch, L., ... & Bengio, Y. (2021). SpeechBrain: A general-purpose speech toolkit. https://arxiv.org/abs/2106.0462

Top

Anticipated Start Date:   (Mid August, 2024)

DETAILED JOB DESCRIPTION:     

The Department of Psychology at the Rochester Institute of Technology (RIT; www.rit.edu/psychology) invites candidates to apply for a tenure-track Assistant Professor position starting in August 2024.  We are seeking an energetic and enthusiastic psychologist who will serve as an instructor, researcher, and mentor to students in our undergraduate (Psychology, Neuroscience) and graduate programs (Masters in Experimental Psychology, Ph.D. in Cognitive Science). We are particularly looking to build a cohort of faculty who can contribute to the interdisciplinary Ph.D. program in Cognitive Science and contribute to research, mentoring, and teaching using computational and laboratory methods. Candidates should have expertise in an area of Cognitive Science such as cognitive or behavioral neuroscience, AI, computational/psycho-linguistics, cognitive psychology, comparative psychology, or related areas. We are particularly interested in individuals whose area of research expertise expands the current expertise of the faculty. Candidates who can teach courses in natural language processing or computational modeling courses are especially encouraged to apply.  The Department of Psychology at RIT serves a rapidly expanding student population at a technical university. The position requires a strong commitment to teaching and mentoring, active research and publication, and a strong potential to attract external funding. Teaching and research are priorities for faculty at RIT, and all faculty are expected to mentor students through advising, research and in-class experiences. The successful candidate will be able to teach courses in our undergraduate cognitive psychology track (Memory & Attention, Language & Thought, Decision Making, Judgement & Problem Solving), will be expected to teach research methods/statistics courses at the undergraduate and graduate level, and teach and mentor students in our graduate programs. In addition, candidates must be able to do research and work effectively within the department’s existing lab space. RIT provides many opportunities for collaborative research across the institute in many diverse disciplines such as AI, Digital Humanities, Human-Centered Computing, and Cybersecurity.

We are seeking individuals who have the ability and interest in contributing to a community committed to student-centeredness; professional development and scholarship; integrity and ethics; respect, diversity and pluralism; innovation and flexibility; and teamwork and collaboration. Select to view links to RIT’s core values, honor code, and statement of diversity.

THE COLLEGE/ DEPARTMENT:    

The Department of Psychology at RIT offers B.S., M.S. degrees, Advanced Certificates, minors, immersions, electives, and a new interdisciplinary Ph.D. degree program in Cognitive Science. The B.S. degree provides a general foundation in psychology with specialized training in one of five tracks: biopsychology, clinical psychology, cognitive psychology, social psychology, and developmental psychology.  The M.S. degree is in Experimental Psychology, with an Advanced Certificate offered in Engineering Psychology. We offer accelerated BS/MS programs with AI, Sustainability, and Experimental Psychology. The Ph.D. degree is in Cognitive Science and the program is broadly interdisciplinary with several partner units across the university. We also offer joint B.S. degrees in Human Centered Computing and Neuroscience. 

The College of Liberal Arts is one of nine colleges within Rochester Institute of Technology. The College has over 150 faculty in 13 departments in the arts, humanities and social sciences. The College currently offers fourteen undergraduate degree programs and five Master degrees, serving over 800 students.

THE UNIVERSITY:

Founded in 1829, Rochester Institute of Technology is a diverse and collaborative community of engaged, socially conscious, and intellectually curious minds. Through creativity and innovation, and an intentional blending of technology, the arts and design, we provide exceptional individuals with a wide range of academic opportunities, including a leading research program and an internationally recognized education for deaf and hard-of-hearing students. Beyond our main campus in Rochester, New York, RIT has international campuses in China, Croatia, Dubai, and Kosovo. And with more than 19,000 students and more than 125,000 graduates from all 50 states and over 100 nations, RIT is driving progress in industries and communities around the world. Find out more at www.rit.edu . 

REQUIRED MINIMUM QUALIFICATIONS:

• Have PhD., or PhD. expected by July 1, 2024 in cognitive psychology or cognitive science related specialty (e.g. linguistics);
• Have demonstrated ability to conduct independent research in psychology or closely related fields;
• Have consistently and recently published;
• Have demonstrated teaching ability and have taught college courses independently beyond TA;
• Have demonstrated ability to supervise student research;
• Demonstrate external research grant attainment potential;
• Demonstrate expertise in research and teaching in cognitive science;
• Show a career trajectory that emphasizes a balance between teaching and research;
• Show a fit with the Department of Psychology’s general mission, teaching, research, and resources.
• Ability to contribute in meaningful ways to the college’s continuing commitment to cultural diversity, pluralism, and individual differences.

HOW TO APPLY:

Apply online at http://careers.rit.edu/faculty; search openings, then Keyword Search 8262BR. Please submit your application, curriculum vitae, cover letter addressing the listed qualifications and upload the following attachments: 

• A brief teaching philosophy
• A research statement that includes information about previous grant work, the potential for future grants, and information about one-on-one supervision of student research
• The names, addresses and phone numbers for three references 
• Contribution to Diversity Statement

You can contact the chair of the search committee, Caroline DeLong, Ph.D. with questions on the position at: cmdgsh@rit.edu.

Review of applications will begin October 1, 2023 and will continue until an acceptable candidate is found.

Top

Assistant or Associate Professor of Computer Science, UTEP, El Paso, Texas

The University of Texas at El Paso (UTEP) invites applications for a tenured/tenure-track Associate Professor position and three tenure-track Assistant Professor Positions in Computer Science (CS) starting in fall 2024. We invite applicants from all areas of CS.  For three of the positions (including the Associate Professor position), preference will be given to those with demonstrated expertise in Artificial Intelligence.

Candidates are expected to have a record of high-quality scholarship and should be able to demonstrate the potential for excellence in both research and teaching. The department values both interdisciplinary research and industry/government experience. 

More information and application instructions are at https://www.utep.edu/cs/news/news-2023/assistantassociateprofessor.html

Top

--

Top

PhD Title: Summarization of activities of daily living using sound-based activity recognition

We are seeking candidates for a PhD position in co-tutelle between IMT Atlantique (Brest, France) and Instituto Superior Técnico (Lisbon, Portugal) on the topic 'Summarization of activities of daily living using sound-based activity recognition'.

Please find details in the attached PDF file.
Starting date: before et end of 2023
Closing date for applications: Oct 15, 2023

Top

Dans le cadre de ses activités de production de ressources linguistiques, ELDA recherche des transcripteurs (f/h) de langue maternelle tchèque à temps plein ou partiel pour la transcription de 1500 heures d’enregistrements audio et/ou la révision des transcriptions. Le nombre total d'heures à transcrire ou à réviser sera adapté selon les disponibilités du candidat ou de la candidate.

La mission aura lieu dans les locaux d'ELDA (Paris 13e) ou à distance via un espace sécurisé. La mission peut démarrer dès à présent.

Profil recherché
• Locuteur (f/h) natif du tchèque avec un très bon niveau d'orthographe et de grammaire ;
• Bonne connaissance de la langue française et/ou anglaise ;
• Bonne maîtrise d'outils informatiques ;
• Capacité à intégrer et suivre scrupuleusement des règles de transcription.

Rémunération et durée
• À partir du SMIC horaire selon le profil ;
• Fin du projet prévue pour septembre 2024 ;
• Missions et contrat selon disponibilités.

Candidature :
Envoyer un CV à <gabriele@elda.org> et <dylan@elda.org>

ELDA (Agence pour la Distribution des ressources Linguistiques et l'Evaluation)
9, rue des Cordelières
75013 Paris

www.elda.org

Top

Dans le cadre de ses activités de production de ressources linguistiques, ELDA recherche des transcripteurs (f/h) de langue maternelle estonienne à temps plein ou partiel pour la transcription de 1500 heures d’enregistrements audio et/ou la révision des transcriptions. Le nombre total d'heures à transcrire ou à réviser sera adapté selon les disponibilités du candidat ou de la candidate.

La mission aura lieu dans les locaux d'ELDA (Paris 13e) ou à distance via un espace sécurisé. La mission peut démarrer dès à présent.

Profil recherché
• Locuteur (f/h) natif de l'estonien avec un très bon niveau d'orthographe et de grammaire ;
• Bonne connaissance de la langue française et/ou anglaise ;
• Bonne maîtrise d'outils informatiques ;
• Capacité à intégrer et suivre scrupuleusement des règles de transcription.

Rémunération et durée
• À partir du SMIC horaire selon le profil ;
• Fin du projet prévue pour septembre 2024 ;
• Missions et contrat selon disponibilités.

Candidature :
Envoyer un CV à <gabriele@elda.org> et <dylan@elda.org>

ELDA (Agence pour la Distribution des ressources Linguistiques et l'Evaluation)
9, rue des Cordelières
75013 Paris

www.elda.org

Top

Le laboratoire DDL de l l'Université de Lyon recherche un ingénieur d'étude pour une durée de 4 mois.

L'offre est accessible au lien suivant :

 https://emploi.cnrs.fr/Offres/CDD/UMR5596-MELCAN-001/Default.aspx

Top

Ideal candidates should possess the following qualifications: 

- Proficiency in data analytics and/or machine learning 

- Prior research experience in machine learning or human-computer interaction, preferably prior publication(s) and/or a Masters (with thesis).   

- Prior experience in human-centered applications 

Interested candidates should apply using the following link and list Dr. Theodora Chaspari as a potential Ph.D. advisor:
https://www.colorado.edu/bb/grad-apply 

Join the Human Bio-Behavioral Signals (HUBBS) Lab at CU Boulder! 

The goal of HUBBS Lab is to make fundamental contributions to human-centered machine intelligence (ML) and to promote scientific advancement in trustworthy artificial intelligence (AI). This endeavor highly draws from interdisciplinary collaborations in health and psychological sciences, social sciences, and learning sciences, and leads to interdisciplinary scientific contributions. Main research areas include trustworthy and responsible human-centered AI, including dimensions of privacy-preservation, explainability, and fairness; human-AI teaming and collaborative decision-making; intelligent assistive interfaces for personalized user feedback in education and health; assistive computational technologies for combatting racism and bias; multimodal data analytics. 

Join Our PhD Program in Computer Science at CU Boulder! 

We are committed to providing students with the best possible resources and support throughout their’ PhD journey. 

Our Ph.D. offer includes: 

• At least five years of full funding (tuition, fees, health insurance, dental insurance) plus a stipend of approximately $3K/month for the 9-month academic year (additionally, most students receive the stipend during summer). There are 6 weeks of parental leave and sick leave. 
• A first-year fellowship of $4K to help with relocation and support during the first semester, and a $1K early career professional development fellowship to attend conferences 
• GRE is not required 

The Computer Science Department and CU Boulder have consistently risen in rankings over the years. We are the fastest-growing and largest department within the College of Engineering and Applied Science. The department is home to 50 tenured and tenure-track faculty plus 25 instructional faculty and now hosts nearly 1,700 undergraduate and 500 graduate students. 

Highlights  

• Our faculty members are renowned for their exceptional contributions to academia and research. These include the Alan T. Waterman Award, given for notable achievements in science and engineering, multiple NSF CAREER awards, which are granted to promising researchers in the early stages of their careers, Sloan Research Fellowship, providing support and recognition to early-career scientists and scholars, and more. 
• Many of our students are funded by NSF’s Graduate Research Fellowship Program (GRFP), NASA GRO fellowship, Meta Research PhD Fellowship, Google Ph.D. Fellowship, Amazon Science, among others. 

We are committed to fostering a diverse, inclusive, and academically excellent community. At the college level, our undergraduate student population included 30% who self-identified as women, 27% who self-identified as persons of color, 15% who were first-generation college students, and 14% who were international students. Our graduate student body included 32% of students who self-identified as women, 16% who self-identified as a person of color, and 29% international students. In 2022, 26% of our tenured/tenure track faculty self-identify as women, and 22% self-identify as people of color. 

Location, location, location! 

Boulder is located at the base of the Rocky Mountains in north-central Colorado. Boulder is consistently ranked as one of the happiest and healthiest places to live in the United States, known for its active, outdoorsy lifestyle and a strong sense of community. The city enjoys 300 days of sunshine annually and has over 150 miles of hiking and biking trails, along with easy access to skiing, rock climbing, and other outdoor activities. 

Major companies like Google, Microsoft, Ball Aerospace, and Lockheed Martin have offices in Boulder. The Denver metropolitan area, a 30-minute drive from Boulder, is a world-class city with an international airport with direct flights to Tokyo, Paris, London, and Mexico City. 

Top

The CUBES (Computational Understanding of Behaviors, Experiences, and Subjective states) Lab at the University of Memphis is seeking outstanding candidates for fully funded positions within the PhD program in Computer Science. We are looking for students interested in research at the intersection of machine learning, psychology, and signal processing and specializing in affective computing, human-computer interaction, and ethical human-centered machine learning.

Ideal candidates should have experience in:

-      Data analytics, machine learning, and/or trustworthy and fair AI

-      Human-centered applications either in research or industry

-      Research communication (e.g., publications, presentations, master’s thesis)

Interested candidates should apply to the PhD program at UofM and list Dr. Brandon Booth as a potential PhD advisor. Priority screening of applications for the Spring 2024 term will begin on November 1^st, 2023, and applications will be accepted through December 1^st, 2023. We particularly welcome candidates from groups that are historically underrepresented in computer science.

Join the CUBES Lab at UofM!

The goal of CUBES Lab is to use multimodal AI to understand, track, and promote beneficial mental states/experiences/behaviors in real-life settings without perpetuating group biases. We conduct basic research to realize informative and interpretable representations of experiences, and we aim to close the loop in interactive experience monitoring, scale up experience modeling systems, and find unique ways for human-AI teams to succeed where either alone may fail.  Our work is inclusive of new ideas and directions, especially in interdisciplinary and translational research in education, health, procedural fairness, and other prosocial domains.

Join our PhD Program in Computer Science at UofM!

The University of Memphis is a top-tier research university with a Carnegie R1 designation, and we are committed to engaging PhD students in cutting-edge research in their area of interest.  Our PhD program builds both breadth (through core graduate courses) and depth (via a rich selection of advanced courses and requiring participation in research projects), and it provides opportunities to work with interdisciplinary teams on federally funded research collaborations. For example, CS faculty lead the NIH-funded mDOT Biomedical Technology Resource Center and the Center for Information Assurance (CfIA). In addition, CS faculty work closely with multidisciplinary centers at the university such as the Institute for Intelligent Systems (IIS).

Memphis Highlights

Brandon Booth, PhD (He/Him/His) Assistant Professor Department of Computer Science

The University of Memphis 392 Dunn Hall Memphis, TN 38152 brandon.m.booth@memphis.edu memphis.edu/brandon-booth

Top

--

Top

Post Doc  position: Natural Language Processing, Saarland University, Germany

=============================================================

(Computer Science, Computational Linguistics  or similar)

The research group is focusing on getting a deeper understanding of how modern deep learning methods can be applied to natural languages. Our recent achievements include a best paper award at COLING 2022 and a best theme paper award at ACL 2023. We offer a PostDoc  position that is topically open and should have a strong focus on applying machine learning techniques to natural language data. The research should on the one hand be connected to ongoing research of PhD students and at the same time pursue a clear new direction. 

The ideal candidate for the position would have:

   1. Solid experience in natural language processing

   2. Excellent knowledge of machine learning and deep learning

   3. Be involved, knowledgeable and generous in scientific discussions with all group members

   4. Excellent programming skills

   5. Doctoral degree in Computer Science, Computational Linguistics or similar

Salary: The PostDoc  position will be 100% of full time on the German E13 scale (TV-L) which is about 4188€ per month before tax and social security contributions. The appointments will be for two years with a possible extension.

About the department: The department of Language Science and Technology is one of the leading departments in the speech and language area in Europe. The flagship project at the moment is the CRC on Information Density and Linguistic Encoding. It also runs a significant number of European and nationally funded projects. In total, it has seven faculty and around 50 postdoctoral researchers and PhD students. The department is part of the Saarland Informatics Campus. With 900 researchers, two Max Planck institutes and the German Research Center for Artificial Intelligence, it is one of the leading locations for Informatics in Germany and Europe.

How to apply: Please send us a letter of motivation, a research plan (max one page), your CV, your transcripts, a list of publications, and the names and contact information of at least two references, as a single PDF or a link to a PDF if the file size is more than 5 MB.

Please apply latest by November 20th, 2023. Earlier applications are welcome and will be processed as they come in.

Contact: Applications and any further inquiries regarding the project should be directed to dietrich.klakow at lsv.uni-saarland.de 

Top

Master 2 Internship Proposal

Advisors: Jules Cauzinille, Benoˆıt Favre, Arnaud Rey

November 2023

Deep transfer knowledge from speech to primate vocalizations

Keywords: Computational bioacoustics, deep learning, self-supervised learning, transfer knowledge, efficient fine-tuning, primate vocalizations

1 Context This internship takes part in a multidisciplinary research project aimed at bridging the gap between state of the art deep leaning methods developed for speech processing and computational bioacoustics. Computational bioacoustics is a relatively new research filed which proposes to tackle the study of animal acoustic communication with computational approaches Stowell [2022]. Recently, bioacousticians are showing increasing interest for the deep learning revolution embodied in transformer architectures and self-supervised pre-trained models, but much investigation still needs to be carried out. We propose to test the viability of self-supervision and knowledge transfer as a bioacoustic tool by pre-training models on speech and using them for primate vocalisation analysis.

2 Problem Statement Speech based models are able to reach convincing performance on primate-related tasks including segmentation, individual identification or call type classification Sarkar and Doss [2023] as they are with many different downstream tasks (such as vocal emotion recognition Wang et al. [2021]). We have tested publicly available models such as HuBERT Hsu et al. [2021] and Wav2Vec2 [Schneider et al., 2019], two self-supervised speech-based architectures, on some of these tasks with Gibbon vocalizations. Our method involves probing and traditional fine-tuning of these models.

As to ensure true knowledge transfer from pre-training speech datasets to the downstream classification tasks, the goal of this internship will be to implement efficient fine-tuning methods in a similar fashion. These will allow to limit and control the amount of information lost in the finetuning process. Depending on the interests of the candidate, the methods can include prompt tuning Lester et al. [2021], attention prompting Gao et al. [2023], low rank adaptation Hu et al. [2021] or adversarial reprogramming Elsayed et al. [2018]. The candidate will also be free to explore other methods relevant to the question at hand, either on Gibbons or other species data-sets currently being collected.

3 Profile The intern will propose and implement the efficient fine-tuning solutions on an array of (preferably self-supervised) acoustic models pre-trained on speech or general sound such as HuBERT, Wav2vec, WavLM, VGGish, etc. Exploring adversial re-programming of models pre-trained on other modalities (images, videos, etc.) could also be carried out. The work will be implemented using pytorch.The candidate must have the following qualities :

• Excellent knowledge of deep learning methods

• Extensive experience with PyTorch models

• An interest in processing bioacoustic data

• An interest in reading and writing scientific papers as well as some curiosity for

research challenges

The internship will last 6 months at the LIS and LPC laboratories in Marseille during spring 2024.

The candidate will work in close collaboration with Jules Cauzinille as part of his thesis on “Self-supervised learning for primate vocalization analysis”. The candidate will also be in contact with the researchers community of the ILCB.

4 Contact Please send a CV, transcripts and a letter of application to jules.cauzinille@lis- lab.fr, benoit.favre@lislab.fr, and arnaud.rey@cnrs.fr. Do not hesitate to contact us if you have any question (or if you want to hear what our primates sound like).

References

Gamaleldin F. Elsayed, Ian Goodfellow, and Jascha Sohl-Dickstein. Adversarial reprogramming of neural networks, 2018.

Peng Gao, Jiaming Han, Renrui Zhang, Ziyi Lin, Shijie Geng, Aojun Zhou, Wei Zhang, Pan Lu, Conghui He, Xiangyu Yue, Hongsheng Li, and Yu Qiao. Llama-adapter v2: Parameter-efficient visual instruction model, 2023.

Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, and Abdelrahman Mohamed. Hubert: Self-supervised speech representation learning by masked prediction of hidden units. IEEE/ACM Transactions on Audio, Speech, and Language Processing, PP:1–1, 2021. doi: 10.1109/TASLP.2021.3122291.

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. Lora: Low-rank adaptation of large language models, 2021.

Brian Lester, Rami Al-Rfou, and Noah Constant. The power of scale for parameter-efficient prompt tuning, 2021.

Eklavya Sarkar and Mathew Magimai Doss. Can Self-Supervised Neural Networks Pre-Trained on Human Speech distinguish Animal Callers?, May 2023. arXiv:2305.14035 [cs, eess].

Steffen Schneider, Alexei Baevski, Ronan Collobert, and Michael Auli. wav2vec: Unsupervised Pre-Training for Speech Recognition. In Proc. Interspeech 2019, pages 3465–3469, 2019. doi: 10.21437/Interspeech.2019-1873.

Dan Stowell. Computational bioacoustics with deep learning: a review and roadmap. 10:e13152, 2022. ISSN 2167-8359. doi: 10.7717/peerj.13152. URL https://peerj.com/articles/13152.

Yingzhi Wang, Abdelmoumene Boumadane, and Abdelwahab Heba. A fine-tuned wav2vec 2.0/hubert benchmark for speech emotion recognition, speaker verification and spoken language understanding. CoRR, abs/2111.02735, 2021. doi: 10.48550/arXiv.2111.02735

Top

-- Post-doctoral research position - L3i - La Rochelle France

---------------------------------------------------------------------------------------------------------------------------

Title : Emotion detection by semantic analysis of the text in comics speech balloons

The L3i laboratory has one open post-doc position in computer science, in the specific field of natural language processing in the context of digitised documents.

Duration: 12 months (an extension of 12 months will be possible)

Position available from: as soon as possible

Salary: approximately 2100 € / month (net)

Place: L3i lab, University of La Rochelle, France

Specialty: Computer Science/ Document Analysis/ Natural Language Processing

Contact: Jean-Christophe BURIE (jcburie [at] univ-lr.fr) / Antoine Doucet (antoine.doucet [at] univ-lr.fr)

Position Description

The L3i is a research lab of the University of La Rochelle. La Rochelle is a city in the south west of France on the Atlantic coast and is one of the most attractive and dynamic cities in France. The L3i works since several years on document analysis and has developed a well-known expertise in ‘Bande dessinée”, manga and comics analysis, indexing and understanding.

The work done by the post-doc will take part in the context of SAiL (Sequential Art Image Laboratory) a joint laboratory involving L3i and a private company. The objective is to create innovative tools to index and interact with digitised comics. The work will be done in a team of 10 researchers and engineers.

The team has developed different methods to extract and recognise the text of the speech balloons. The specific task of the recruited researcher will be to use Natural Language Processing strategies to analyse the text in order to identify emotions expressed by a character (reacting to the utterance of another speaking character) or caused by it (talking to another character). The datasets will be collections of comics in French and English.

Qualifications

Candidates must have a completed PhD and a research experience in natural language processing. Some knowledge and experience in deep learning is also recommended.

General Qualifications

• Good programming skills mastering at least one programming language like Python, Java, C/C++

• Good teamwork skills

• Good writing skills and proficiency in written and spoken English or French

Applications

Candidates should send a CV and a motivation letter to jcburie [at] univ-lr.fr and antoine.doucet [at] univ-lr.fr.

Top

M2 Master Internship

Automatic Alsatian speech recognition 

1 Supervisors

Name: Emmanuel Vincent

Team and lab: Multispeech team, Inria research center at Université de Lorraine, Nancy

Email: emmanuel.vincent@inria.fr

Name: Pascale Erhart

Team and lab: Language/s and Society team, LiLPa, Strasbourg

Email: pascale.erhart@unistra.fr

2 Motivation and context This internship is part of the Inria COLaF project (Corpora and tools for the languages of France), whose objective is to develop and disseminate inclusive language corpora and technologies for regional languages (Alsatian, Breton, Corsican, Occitan, Picard, etc.), overseas languages and non-territorial immigration languages of France. With few exceptions, these languages are largely ignored by language technology providers [1]. However, such technologies are keys to the protection, promotion and teaching of these languages. Alsatian is the second regional language spoken in France in terms of number of speakers, with 46% of Alsace residents saying they speak Alsatian fairly well or very well [2]. However, it remains an underresourced language in terms of data and language technologies. Attempts at machine translation have been made as well as data collection [3].

3 Objectives The objective of the internship is to design an automatic speech recognition system for Alsatian based on sound archives (radio, television, web, etc.). This raises two challenges: i) Alsatian is not a homogeneous language but a continuum of dialectal varieties which are not always written in a standardized way, ii) the textual transcription is often unavailable or differs from the pronounced words (transcription errors , subtitles, etc.). Solutions will be based on i) finding a suitable methodology for choosing and preparing data, ii) designing an automatic speech recognition system using end-to-end neural networks which can rely on the adaptation of an existing multilingual system like Whisper [4] in a self-supervised manner from a number of untranscribed recordings [5] and in a supervised manner from a smaller number of transcribed recordings, or even from text-only data [6]. The work will be based on datasets collected by LiLPa and the COLaF project’s engineers, which include the television shows Sunndi's Kater [7] and Kùmme Mit [8] whose dialogues are scripted, some radio broadcasts from the 1950s–1970s with their typescripts [9], as well as untranscribed radio broadcasts of France Bleu Elsass. Dictionaries of Alsatian such as the Wörterbuch der elsässischen Mundarten which can be consulted via the Woerterbuchnetz portal [10] or phonetization initiatives [11] could be exploited, for example using Orthal spelling [12]. The internship opens the possibility of pursuing a PhD thesis funded by the COLaF project.

4 Bibliography

[1] DGLFLF, Rapport au Parlement sur la langue française 2023, https://www.culture.gouv.fr/Media/Presse/Rapport-au-Parlement-surla-langue-francaise-2023

[2] https://www.alsace.eu/media/5491/cea-rapport-esl-francais.pdf

[3] D. Bernhard, A-L Ligozat, M. Bras, F. Martin, M. Vergez-Couret, P. Erhart, J. Sibille, A. Todirascu, P. Boula de Mareüil, D. Huck, “Collecting and annotating corpora for three under-resourced languages of France: Methodological issues”, Language Documentation & Conservation, 2021, 15, pp.316-357.

[4] A. Radford, J.W. Kim, T. Xu, G. Brockman, C. McLeavey, I. Sutskever, “Robust speech recognition via large-scale weak supervision”, in 40th International Conference on Machine Learning, 2023, pp. 28492-28518.

[5] A. Bhatia, S. Sinha, S. Dingliwal, K. Gopalakrishnan, S. Bodapati, K. Kirchhoff, “Don't stop selfsupervision: Accent adaptation of speech representations via residual Adapters”, in Interspeech, 2023, pp. 3362-3366.

[6] N. San, M. Bartelds, B. Billings, E. de Falco, H. Feriza, J. Safri, W. Sahrozi, B. Foley, B. McDonnell, D. Jurafsky, “Leveraging supplementary text data to kick-start automatic speech recognition system development with limited transcriptions”, in 6th Workshop on Computational Methods for Endangered Languages, 2023, pp. 1-6.

[7] https://www.france.tv/france-3/grand-est/sunndi-s-kater/ [8] https://www.france.tv/france-3/grand-est/kumme-mit/toutes-les-videos/ [9] https://www.ouvroir.fr/cpe/index.php?id=1511 [10] https://woerterbuchnetz.de/?sigle=ElsWB#0 [11] 10.5281/zenodo.1174213 [12] https://orthal.fr/ 

5 Profile MSc in speech processing, natural language processing, computational linguistics, or computer science. Strong programming skills in Python/Pytorch. Knowledge of Alsatian and/or German is a plus, but in no way a prerequisite

Top

Evaluation des systèmes de synthèse de la parole dans un environnement bruyant

 Sujet L’´evaluation perceptive est capitale dans de nombreux domaines li´es au technologie de la parole dont la synth`ese de la parole. Elle permet d’´evaluer la qualit´e de la synth`ese de mani`ere subjective en demandant `a un jury[5] de noter la qualit´e d’un stimuli de parole synth´etis´ee[1, 2]. De r´ecent travaux ont permis de d´evelopper un mod`ele d’intelligence artificielle[3, 4] qui permet de pr´edire l’´evaluation subjective d’un segment de parole synth´etis´ee, ainsi permettant de s’affranchir d’un test par jury. Le probl`eme majeur de cette ´evaluation est l’interpr´etation du mot “qualit´e”. Certains peuvent baser leur jugement sur les caract´eristiques intrins`eques de la parole (tel que le timbre, le d´ebit de parole, la ponctuation, etc) alors que d’autres peuvent baser leur jugement sur les caract´eristiques li´es au signal audio (comme la pr´esence ou non de distorsion). Ainsi, l’´evaluation subjective de la parole peut ˆetre biais´ee par l’interpr´etation de la consigne par les auditeurs. Par cons´equent, le mod`ele d’intelligence artificielle mentionn´e ci-dessus peut ˆetre ainsi bas´e sur des mesures biais´ees. Le projet a pour but de r´ealiser un travail exploratoire pour ´evaluer la qualit´e de la synth`ese de la parole d’une mani`ere plus robuste que celle ayant ´et´e propos´e jusqu’ici. Pour ceci, nous partons de l’hypoth`ese que la qualit´e de la synth`ese de la parole peut ˆetre estim´ee par le biais de sa d´etection dans un environnement r´eel. En d’autre termes, un signal synth´etis´e parfaitement pour reproduire un signal de parole humaine ne devrait pas ˆetre d´etect´e dans un environnement de la vie quotidienne. Bas´e sur cette hypoth`ese, nous proposons donc de monter une exp´erience de perception de la parole en milieu bruyant. Il existe des m´ethodes de reproduction de milieu sonore qui permettent de simuler un environnement existant au casque. L’avantage de ces m´ethodes c’est qu’il est ´egalement possible de jouer un enregistrement d’un milieu r´eel au casque tout en ajoutant des signaux comme s’il avait ´et´e pr´esent dans la sc`ene sonore enregistr´ee. Ceci implique d’une part une campagne de mesure acoustique dans des environnement bruyant de la vie quotidienne (transport, open space, cantine, etc). Ensuite, une g´en´eration de parole synth´etis´ee sera n´ecessaire tout en prenant en compte le contexte des enregistrements. Il sera ´egalement pertinent de faire varier les param`etres de la parole synth´etis´ee tout en gardant la mˆeme s´emantique. Les enregistrements de la vie quotidienne seront ensuite mix´es aux signaux de parole synth´etis´ee pour ´evaluer la d´etection de cette derni`ere. Nous utiliserons le pourcentage de fois que la parole synth´etis´ee sera d´etect´ee comme indicateur de qualit´e. Ces pourcentages de d´etection seront ensuite compar´es au pr´ediction du mod`ele d’intelligence artificielle mentionn´e ci-dessus. Ainsi, nous pourrons conclure (1) si les m´ethodes sont ´equivalentes ou compl´ementaires et (2) quel(s) param`etre(s) de la parole synth´etis´ee engendre une d´etection de cette derni`ere en milieu bruyant.

Informations compl´ementaires:

• Encadrement: Le stage sera co-encadr´e par Aghilas Sini, maˆıtre de conf´erence au Laboratoire d’Informatique de l’Universit´e du Mans (aghilas.sini@univ-lemans.fr) et Thibault Vicente, maˆıtre de conf´erence au Laboratoire d’Acoustique de l’Universit´e du Mans (thibault.vicente@univ-lemans.fr)

• Niveau requis: Stage de M2 recherche

• P´eriode envisag´ee: 6 mois (F´evrier `a Juillet 2024)

• Lieu: Le Mans Universit´e

• mots-cl´es: parole synth´etis´ee, synth`ese sonore binaurale, test par jury

References

[1] Y.-Y. Chang. Evaluation of tts systems in intelligibility and comprehension tasks. In Proceedings of the 23rd Conference on Computational Linguistics and Speech Processing (ROCLING 2011), pages 64–78, 2011.

[2] J. Chevelu, D. Lolive, S. Le Maguer, and D. Guennec. Se concentrer sur les diff´erences: une m´ethode d’´evaluation subjective efficace pour la comparaison de syst`emes de synth`ese (focus on differences: a subjective evaluation method to efficiently compare tts systems*). In Actes de la conf´erence conjointe JEP-TALN-RECITAL 2016. volume 1: JEP, pages 137–145, 2016.

[3] C.-C. Lo, S.-W. Fu, W.-C. Huang, X. Wang, J. Yamagishi, Y. Tsao, and H.-M. Wang. MOSNet: Deep Learning-Based Objective Assessment for Voice Conversion. In Proc. Interspeech 2019, pages 1541–1545, 2019.

[4] G. Mittag and S. M¨oller. Deep learning based assessment of synthetic speech naturalness. arXiv preprint arXiv:2104.11673, 2021.

[5] M. Wester, C. Valentini-Botinhao, and G. E. Henter. Are we using enough listeners? no!—an empirically-supported critique of interspeech 2014 tts evaluations. In 16th Annu. Conf. Int. Speech Commun. Assoc., 2015.

Top

ANR Project «REVITALISE»

Automatic speech analysis of public talks.

Description. Today, humanity has reached a stage at which extremely important aspects (such as information exchange) are tied not only to actual so-called hard skills, but also to soft skills. One such important skill is public speaking. Like many forms of interaction between people, the assessment of public speaking depends on many factors (often subjectively perceived). The goal of our project is to create an automatic system which can take into account these different factors and evaluate the quality of the performance. This requires understanding which elements can be assessed objectively and which vary depending on the listener [Hemamou, Wortwein, Chollet21]. For such an analysis, it is necessary to analyze public speaking at various levels: high-level (audio, video, text), intermediate (voice monotony, auto-gestures, speech structure, and etc.) and low-level (fundamental frequency, action units, POS / tags, and etc.) [Barkar]. This internship offers an opportunity to analyze the audio component of a public speech. The student is asked to solve two main problems. The engineering task is to create an automatic speech transcription system that detects speech disfluency. To do this, it is proposed to collect a bibliography on this topic and come up with an engineering solution. The second, research task, is to use audio cues to automatically analyze the success of a performance of a talk. This internship will give you an opportunity to solve an engineering problem as well as learn more about research approaches. By the end you will have expertise in audio processing as well and machine learning methods for multimodal analysis. If the internship is successfully completed, an article may be published. PhD position fundings on Social Computing will be accessible in the team at the end of the internship (at INRIA).

Registration & Organisation. Name of organization: Institut Polytechnique de Paris, Telecom-Paris Website of organization: https://www.telecom-paris.fr Department: IDS/LTCI/ Address: Palaiseau, France

Supervision. Supervision will include weekly meetings with the main supervisor and regular meetings (every 2-3 weeks) with co-supervisors. Telecom-Paris, 2023-2024 ANR Project «REVITALISE» Name of supervisor: Alisa BARKAR Name of co-supervisor: Chloe Clavel, Mathieu Chollet, Béatrice BIANCARDI Contact details: alisa.barkar@telecom-paris.fr

Duration & Planning. The internship is planned as a 5-6 month full-time internship for the spring semester 2024. 6 months considers 24 weeks within which it will be covered following list of activities:

● ACTIVITY 1(A1): Problem description and integration to the working environment

● ACTIVITY 2(A2): Bibliography overview

● ACTIVITY 3(A3): Implementation of the automatic transcription with detected discrepancies

● ACTIVITY 4(A4): Evaluation of the automatic transcription

● ACTIVITY 5(A5): Application of the developed methods to the existing data

● ACTIVITY 6(A6): Analysis of the importance of para-verbal features for the performance perception

● ACTIVITY 7(A7): Writing the report

Selected references of the team.

1. [Hemamou] L. Hemamou, G. Felhi, V. Vandenbussche, J.-C. Martin, C. Clavel, HireNet: a Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviews. in AAAI 2019, to appear

2. [Ben-Youssef] Atef Ben-Youssef, Chloé Clavel, Slim Essid, Miriam Bilac, Marine Chamoux, and Angelica Lim. Ue-hri: a new dataset for the study of user engagement in spontaneous human-robot interactions. In Proceedings of the 19th ACM International Conference on Multimodal Interaction, pages 464–472. ACM, 2017.

3. [Wortwein] Torsten Wörtwein, Mathieu Chollet, Boris Schauerte, Louis-Philippe Morency, Rainer Stiefelhagen, and Stefan Scherer. 2015. Multimodal Public Speaking Performance Assessment. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI '15). Association for Computing Machinery, New York, NY, USA, 43–50.

4. [Chollet21] Chollet, M., Marsella, S., & Scherer, S. (2021). Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback. Journal on Multimodal User Interfaces, 1-13.

5. [Barkar] Alisa Barkar, Mathieu Chollet, Beatrice Biancardi, and Chloe Clavel. 2023. Insights Into the Importance of Linguistic Textual Features on the Persuasiveness of Public Speaking. In Companion Publication of the 25th International Conference on Multimodal Interaction (ICMI '23 Companion). Association for Computing Machinery, New York, NY, USA, 51–55. https://doi.org/10.1145/3610661.3617161 Telecom-Paris, 2023-2024 ANR Project «REVITALISE»

Other references.

1. Dinkar, T., Vasilescu, I., Pelachaud, C. and Clavel, C., 2020, May. How confident are you? Exploring the role of fillers in the automatic prediction of a speaker’s confidence. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 8104-8108). IEEE.

2. Whisper: Robust Speech Recognition via Large-Scale Weak Supervision, Radford A. et al., 2022, url: https://arxiv.org/abs/2212.04356

3. Romana, Amrit and Kazuhito Koishida. “Toward A Multimodal Approach for Disfluency Detection and Categorization.” ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2023): 1-5.

4. Radhakrishnan, Srijith et al. “Whispering LLaMA: A Cross-Modal Generative Error Correction Framework for Speech Recognition.” ArXiv abs/2310.06434 (2023): n. pag.

5. Wu, Xiao-lan et al. “Explanations for Automatic Speech Recognition.” ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2023): 1-5.

6. Min, Zeping and Jinbo Wang. “Exploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Study.” ArXiv abs/2307.06530 (2023): n. pag.

7. Ouhnini, Ahmed et al. “Towards an Automatic Speech-to-Text Transcription System: Amazigh Language.” International Journal of Advanced Computer Science and Applications (2023): n. pag.

8. Bigi, Brigitte. “SPPAS: a tool for the phonetic segmentations of Speech.” (2023).

9. Rekesh, Dima et al. “Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition.” ArXiv abs/2305.05084 (2023): n. pag.

10. Arisoy, Ebru et al. “Bidirectional recurrent neural network language models for automatic speech recognition.” 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2015): 5421-5425.

11. Padmanabhan, Jayashree and Melvin Johnson. “Machine Learning in Automatic Speech Recognition: A Survey.” IETE Technical Review 32 (2015): 240 - 251.

12. Berard, Alexandre et al. “End-to-End Automatic Speech Translation of Audiobooks.” 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2018): 6224-6228.

13. Kheir, Yassine El et al. “Automatic Pronunciation Assessment - A Review.” ArXiv abs/2310.13974 (2023): n. pag. Telecom-Paris, 2023-2024

Top

Title: Predictive Modeling of Subjective Disagreement in Speech Annotation/Evaluation Host laboratory : LIUM

Location : Le Mans

Supervisors : Meysam Shamsi, Anthony Larcher

Beginning of internship : February 2024

Application deadline : 10/01/2024

Keywords: Subjective Disagreement Modeling, Synthetic Speech Quality Evaluation, Speech Emotion Recognition In the context of modeling subjective tasks, where diverse opinions, perceptions, and judgments exist among individuals, such as in speech quality or speech emotion recognition, addressing the challenge of defining ground truth and annotating a training set becomes crucial. The current practice of aggregating all annotations into a single label for modeling a subjective task is neither fair nor efficient [1]. The variability in annotations or evaluations can stem from various factors [2], broadly categorized into those associated with corpus quality and those intrinsic to the samples themselves. In the first case, the delicate definition of a subjective task introduces sensitivity into the annotation process, potentially leading to more errors, especially where the annotation tools and platform lack precision or annotators experience fatigue. In the second case, the inherent ambiguity in defining a subjective task and different perception may result in varying annotations and disagreements. Developing a predictive model to understand annotator/evaluator disagreement is crucial for engaging in discussions related to ambiguous samples and refining the definition of subjective concepts. Furthermore, this model can serve as a valuable tool for assessing the confidence of automatic evaluations [3,4]. This modeling approach will contribute to the automatic evaluation of corpus annotations, identification of ambiguous samples for reconsideration or re-annotation, automatic assessment of subjective models, and the detection of underrepresented samples and biases in the dataset. The proposed research involves utilizing a speech dataset such as MS-Podcast [5], SOMOS [6], VoiceMOS [7], for a subjective task with multiple annotations per sample. The primary objective is to predict the variation in assigned labels, measured through disagreement scores, entropy, or distribution.

Reference: [1]. Davani, A. M., Díaz, M., & Prabhakaran, V. (2022). Dealing with disagreements: Looking beyond the majority vote in subjective annotations. Transactions of the Association for Computational Linguistics, 10, 92-110.

[2]. Kreiman, J., Gerratt, B. R., & Ito, M. (2007). When and why listeners disagree in voice quality assessment tasks. The Journal of the Acoustical Society of America, 122(4), 2354-2364.

[3]. Wu, W., Chen, W., Zhang, C., & Woodland, P. C. (2023). It HAS to be Subjective: Human Annotator Simulation via Zero-shot Density Estimation. arXiv preprint arXiv:2310.00486.

[4]. Han, J., Zhang, Z., Schmitt, M., Pantic, M., & Schuller, B. (2017, October). From hard to soft: Towards more human-like emotion recognition by modelling the perception uncertainty. In Proceedings of the 25th ACM international conference on Multimedia (pp. 890-897).

[5]. Lotfian, R., & Busso, C. (2017). Building naturalistic emotionally balanced speech corpus by retrieving emotional speech from existing podcast recordings. IEEE Transactions on Affective Computing, 10(4), 471-483.

[6]. Maniati, G., Vioni, A., Ellinas, N., Nikitaras, K., Klapsas, K., Sung, J.S., Jho, G., Chalamandaris, A., Tsiakoulis, P. (2022) SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis. Proc. Interspeech 2022, 2388-2392 [7]. Cooper, E., Huang, W. C., Tsao, Y., Wang, H. M., Toda, T., & Yamagishi, J. (2023). The VoiceMOS Challenge 2023: Zero-shot Subjective Speech Quality Prediction for Multiple Domains. arXiv preprint arXiv:2310.02640.

Applicant profile : Candidate motivated by artificial intelligence, enrolled in a Master's degree in Computer Science or related fields

For application: Send CV + cover letter to : meysam.shamsi@univ-lemans.fr or anthony.larcher@univ-lemans.fr before 10/01/2024

Top

Senior Data Scientist at the University of Chicago

Please apply at https://uchicago.wd5.myworkdayjobs.com/External/job/Chicago-IL/Sr-Data-Scientist_JR24587

About the Department
 

The TMW Center for Early Learning + Public Health (TMW Center) develops science-based interventions, tools, and technologies to help parents and caregivers interact with young children in ways that maximize brain development. A rich language environment is critical to healthy brain development, however few tools exist to measure the quality or quantity of these environments. Access to this type of data allows caregivers to enhance interactions in real-time and gives policy-makers insight in how to best build policies that have a population-level impact.

The wearable team within TMW Center is building a low-cost wearable device that can reliably and accurately measure a child’s early language environment vis-à-vis the conversational turns between a child and caregiver. The goal is to provide accurate, real-time feedback that empowers parents and caregivers to create the best language environment for their children.

Job Summary
 

The job works independently to perform a variety of activities relating to software support and/or development. Analyzes, designs, develops, debugs, and modifies computer code for end user applications, beta general releases, and production support. Guides development and implementation of applications, web pages, and user-interfaces using a variety of software applications, techniques, and tools. Solves complex problems in administration, maintenance, integration, and troubleshooting of code and application ecosystem currently in production.

We are searching for a strategic and inquisitive senior data scientist to develop and optimize innovative AI-based models focused on speech/audio processing. The senior data scientist is expected to outline requirements, brainstorm ideas and solutions with leadership, manage data integrity and conduct experiments, assign tasks to junior staff, and monitor performance of the team.

Responsibilities

• Formulates, suggests, and manages data-driven projects to support the development of audio algorithms and use cases.
• Analyzes data from various entities for later use by junior data scientists.
• Assesses scope and timelines, prioritize goals, and prepare project plans to meet product and research objectives.
• Delegates tasks to junior data scientists and provide coaching to improve quality of work.
• Continuously trains and nurtures data scientists to take on bigger assignments.
• Provides leadership in advancing the science of TMW Center interventions by generating new ideas and collaborating with the research analysis team.
• In collaboration with CTO, selects and guides decisions on statistical procedures and model selections, including conducting exploratory experiments to develop proof of concept.
• Cross-validate models to ensure generalization and predictability.
• Stays informed about developments in Data Science and adjacent fields to ensure most relevant methods and outputs are being leveraged.
• Ensures data governance is in place to comply with regulations and privacy standards and maintain documentation of methodologies, coding, and results.
• Designs new systems, features, and tools. Solves complex problems and identifies opportunities for technical improvement and performance optimization. Reviews and tests code to ensure appropriate standards are met.
• Utilizes technical knowledge of existing and emerging technologies, including public cloud offerings from Amazon Web Services, Microsoft Azure, and Google Cloud.
• Acts as a technical consultant and resource for faculty research, teaching, and/or administrative projects.
• Performs other related work as needed.

Minimum Qualifications
 

Education:

Minimum requirements include a college or university degree in related field.

---
Work Experience:

Minimum requirements include knowledge and skills developed through 5-7 years of work experience in a related job discipline.

---
Certifications:

---

Preferred Qualifications

Education:

• Master’s degree in Computer Science, Statistics, Mathematics, or Economics with a focus on computer science.

Experience:

• Experience with Machine Learning and LLMs.
• Experience working on audio or speech data.
• Experience implementing edge models using TensorFlow micro, TensorFlow lite, and corresponding quantization techniques.
• Experience building audio classification models or speech to text models.
• Experience using the latest pre-trained models such as whisper and wav2vec.
• Proven experience taking an idea or user need and translating it into fully realized applications.
• Ability to relay insights in layman’s terms to inform business decisions. 
• 3+ years leading and managing junior data scientists.

Technical Skills or Knowledge:

• Proficiency in Python, Pytorch, Tensorflow, TinyML, Pandas and Numpy.
• Experience with cloud environments such as AWS, Azure or GCloud.
• Experience with command line interfaces (Linux, SSH).
• Experience processing large datasets with Spark, Dask or Ray.

Application Documents

• Resume (required)
• Cover Letter (preferred)

When applying, the document(s) MUST be uploaded via the My Experience page, in the section titled Application Documents of the application.

Top

Postdoctoral Scholar | Data Sciences and Artificial Intelligence at Penn State University

The Data Sciences and Artificial Intelligence (DS/AI) group at Penn State invites applications for a Postdoctoral Scholar position, set to commence in Fall 2024. This role is centered on cutting-edge research at the nexus of machine learning, deep learning, computer vision, psychology, and biology, with foci on psychology-inspired AI and addressing significant biological questions using AI.

To Apply: https://psu.wd1.myworkdayjobs.com/en-US/PSU_Academic/job/Postdoctoral-Scholar---College-of-IST-Data-Sciences-and-Artificial-Intelligence_REQ_0000050584-1

Qualifications:

• Ph.D. in computer science, A.I., data science, physics, or neuroscience with an emphasis on machine learning, or a closely related field. To qualify, candidates must possess a Ph.D. or terminal degree before their employment starts at Penn State.

• A strong record of publications in high-impact journals or premier peer-reviewed international conferences.

• Prior experience in conducting interdisciplinary/multidisciplinary research is a plus.

About the position:

The successful candidate will be designated as a Postdoctoral Scholar at the College of Information Sciences and Technology (IST) of The Pennsylvania State University. The initial term of the position is for one year, with the possibility of renewal upon performance and fund availability. The scholar will be engaged in two interdisciplinary projects funded by the National Science Foundation, receiving mentorship from Professors James Wang (IST), Brad Wyble (Psychology), and Charles Anderson (Biology). The scholar will collaborate with highly motivated and talented graduate students and benefit from strong career development support, which includes training in teaching, grant proposal writing, and other collaborative work. Qualified candidates will have the ability to teach in IST after successfully completing one semester with approval from college leadership.

To apply:

• Please submit a CV, research statement (max 3 pages), and other pertinent documents in a single PDF document with the application.

• Deadline: February 29, 2024, for full consideration. Late applications are accepted but given secondary priority.

• Only shortlisted candidates will be contacted to provide reference letters.

• For inquiries, please email with the subject line “postdoc” to Professor James Wang at jwang@ist.psu.edu or visit the lab website http://wang.ist.psu.edu.

COMMITMENT TO DIVERSITY:

The College of IST is strongly committed to a diverse community and to providing a welcoming and inclusive environment for faculty, staff and students of all races, genders, and backgrounds. The College of IST is committed to making good faith efforts to recruit, hire, retain, and promote qualified individuals from underrepresented minority groups including women, persons of color, diverse gender identities, individuals with disabilities, and veterans. We invite applicants to address their engagement in or commitment to inclusion, equity, and diversity issues as they relate to broadening participation in the disciplines represented in the college as well as aligning with the mission of the College of IST in a separate statement.

CAMPUS SECURITY CRIME STATISTICS:

Top

L’équipe SAMoVA de l’IRIT à Toulouse propose plusieurs stages (M1, M2, PFE ingénieur) en 2024 autour des thématiques suivantes (liste non exhaustive) :

- Génération Automatique De Partitions Musicales Dans Le Style Choro

Top

Nous proposons un stage de recherche (Bac+5) au service recherche de l'Institut National de l'Audiovisuel (INA). Le stage porte sur la détection de l'activité vocale dans des corpus audiovisuels à l'aide de représentations auto-supervisées.
Vous trouverez ci-joint l'offre de stage détaillée.

D'autres stages sont également proposés au sein de l'INA, l'ensemble des sujets peuvent être retrouvés sur la page suivante : https://www.ina.fr/institut-national-audiovisuel/equipe-recherche/stages.

Détection de l'activité vocale dans des corpus audiovisuels à l'aide de représentations auto-supervisées Stage de fin d’études d’Ingénieur ou de Master 2 – Année académique 2023-2024

Mots clés : deep learning, machine learning, self supervised models, voice activity detection, speech activity detection, wav2vec 2.0 Contexte L’Institut National de l’Audiovisuel (INA) est un établissement public à caractère industriel et commercial (EPIC), dont la mission principale consiste à sauvegarder et promouvoir le patrimoine audiovisuel français à travers la vente d’archives et la gestion du dépôt légal. À ce titre, l’Institut capte en continu 180 chaînes de télévision et radio et stocke plus de 25 millions d’heures de contenu audiovisuel. L’INA assure également des missions de formation, de production et de recherche scientifique. Le service de la recherche de l’INA mène depuis plus de 20 ans des travaux de recherche dans le domaine de l’indexation et de la description automatique de ces fonds selon l’ensemble des modalités : textes, sons et images. Le service participe à de nombreux projets collaboratifs de recherche que ce soit dans un cadre national et européen et accueille des stages de Master ainsi que des doctorants en co-encadrement avec des laboratoires nationaux d’excellence. Ce stage est proposé au sein de l’équipe de recherche (https://recherche.ina.fr) et se place dans le cadre d’un projet collaboratif financé par l’ANR : Gender Equality Monitor (GEM). D’autres sujets de stage sont également proposés dans l’équipe : https://www.ina.fr/institut-national-audiovisuel/equipe-recherche/stages

Objectifs du stage La détection d’activité vocale (Voice Activity Detection - VAD) est une tâche d’analyse audio qui vise à identifier les portions d’enregistrement contenant de la parole humaine, les distinguant des autres parties du signal contenant du silence, des bruits de fond ou de la musique. Souvent considérée comme un prétraitement, cette méthode utilisée en amont des tâches de reconnaissance automatique de la parole, des locuteurs ou des émotions. Si les outils VAD existants permettent d’obtenir d’excellents résultats sur les programmes d’information ou les émissions de plateau [Dou18a, Bre23], les recherches récentes menées à l’INA ont révélé que les performances des systèmes état-de-l’art sont moindres pour un grand nombre de matériaux peu représentés dans les corpus de parole annotés. Ces contenus, qui ont fait l’objet d’une campagne d’annotation interne, incluent des émissions musicales, des dessins animés, du sport, des fictions, des jeux télévisés et des documentaires. L'objectif du stage est de développer des modèles de détection d'activité vocale (VAD) en adoptant une approche fondée sur le paradigme d'apprentissage auto-supervisé et s’appuyant sur les architectures transformerstelles que wav2vec 2.0 [Bae20]. Les modèles basés sur ces architectures permettent d’obtenir des résultats état de l'art sur de nombreuses tâches de traitement de la parole à l’aide de quantités d’exemples annotés limitées : transcription, compréhension, traduction, détection d'émotions, reconnaissance de locuteur, détection du langage, etc [Li22, Huh23, Par23]. Plusieurs études récentes ont démontré l’efficacité des approches auto-supervisées pour la VAD [Gim21, Kun23], mais ont à ce jour été entraînées et évaluées sur des données ne reflétant pas la diversité des contenus audiovisuels. Le stage proposé vise à exploiter les millions d'heures de contenu audiovisuel conservés à l’INA pour l'entraînement et l’amélioration des modèles. Les modèles réalisés seront intégrés au logiciel open-source inaSpeechSegmenter, utilisé entre autres pour le décompte du temps de parole des femmes et des hommes dans les programmes à des fins de recherche ou de régulation du paysage audiovisuel [Dou18b, Arc23].

Valorisation du stage Différentes stratégies de valorisation des travaux seront envisagées, en fonction de leur degré de maturité et des orientations envisagées pour la suite des travaux :

● Diffusion des modèles réalisés sous licence open-source sur HuggingFace et/ou le dépôt Github de l’INA : https://github.com/ina-foss

● Rédaction de publications scientifiques

Conditions du stage Le stage se déroulera sur une période de 4 à 6 mois, au sein du service de la Recherche de l’Ina. Il aura lieu sur le site Bry 2, situé au 28 Avenue des frères Lumière, 94360 Bry-sur-Marne.La·le stagiaire sera encadré·e par Valentin Pelloin et David Doukhan. Un ordinateur équipé d’un GPU sera fourni ainsi qu’un accès au cluster de calcul de l’Institut. Gratification : 760 € brut / mois + 50 % pass navigo

Télétravail : possible une journée par semaine

Contact Pour soumettre votre candidature à ce stage, ou pour solliciter davantage d’informations, nous vous invitons à envoyer votre CV et votre lettre de motivation par e-mail aux adresses suivantes : vpelloin@ina.fr et ddoukhan@ina.fr. Profil recherché ● Étudiant·e en dernière année d’un bac +5 dans le domaine de l’informatique et de l'IA

● Forte appétence pour la recherche académique

● Intérêt pour le traitement automatique de la parole

● Maîtrise de Python et expérience dans l’utilisation de bibliothèques de ML

● Capacité à effectuer des recherches bibliographiques ● Rigueur, Synthèse, Autonomie, Capacité à travailler en équipe

Bibliographie

[Arc23] ARCOM (2023). “La représentation des femmes à la télévision et à la radio - Rapport sur l'exercice 2022” [en ligne].

[Bae20] A. Baevski, H. Zhou, A. Mohamed, and M. Auli, “wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations,” Neural Information Processing Systems, Jun. 2020.

[Bre23] Bredin, H. (2023). pyannote.audio 2.1 speaker diarization pipeline: principle, benchmark, and recipe, in INTERSPEECH 2023, ISCA, pp. 1983–1987.

[Dou18a] Doukhan, D., Carrive, J., Vallet, F., Larcher, A., & Meignier, S. (2018, April). An open-source speaker gender detection framework for monitoring gender equality. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 5214-5218). IEEE.

[Dou18b] Doukhan, D., Poels, G., Rezgui, Z., & Carrive, J. (2018). Describing gender equality in french audiovisual streams with a deep learning approach. VIEW Journal of European Television History and Culture, 7(14), 103-122.

[Gim21] P. Gimeno, A. Ortega, A. Miguel, and E. Lleida, “Unsupervised Representation Learning for Speech Activity Detection in the Fearless Steps Challenge 2021,” in Interspeech 2021, ISCA, Aug. 2021, pp. 4359–4363.

[Huh23] Huh, J., Brown, A., Jung, J. W., Chung, J. S., Nagrani, A., Garcia-Romero, D., & Zisserman, A. (2023). Voxsrc 2022: The fourth voxceleb speaker recognition challenge. arXiv preprint arXiv:2302.10248.

[Kun23] M. Kunešová and Z. Zajíc, “Multitask Detection of Speaker Changes, Overlapping Speech and Voice Activity Using wav2vec 2.0,” in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Jun. 2023, pp. 1–5.

[Li22] Li, M., Xia, Y., & Lin, F. (2022, December). Incorporating VAD into ASR System by Multi-task Learning. In 2022 13th International Symposium on Chinese Spoken Language Processing (ISCSLP) (pp. 160-164). IEEE.

[Par23] Parcollet, T., Nguyen, H., Evain, S., Boito, M. Z., Pupier, A., Mdhaffar, S., ... & Besacier, L. (2023). LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech. arXiv preprint arXiv:2309.05472.

Top