MSE 2701: Sounds of Human Language

Understanding the Science of Speech

Fall 2022


Course Information

Course Description

How do you turn sounds into language? This course explores the sounds used in spoken language and how we use speech to communicate with each other. We will discuss how speech varies between talkers, dialects, and languages, and we will study the mechanisms that listeners use to recognize speech. We will also explore how the brain processes language, how infants and children learn to understand speech, and how research on spoken language helps to inform work in other areas. The course also provides an in depth study of the techniques used to study speech perception, as well as the major theoretical debates that have informed work in this field.

Objectives

Throughout the course, we will explore concepts and techniques used in the scientific study of human speech, including how speech sounds are produced, learned, and perceived. We will examine a number of topics, including questions about language acquisition, how the brain processes speech, and how speech sounds vary between languages. In addition to learning content, the course includes a number of objectives related to understanding the scientific process:

Course Materials

All required reading material will be posted on the course website. I have prepared a set of background readings that provide an introduction to the topics we will be discussing, and there are several research articles we will read during the semester. Be sure to read this material before class! I have endeavored to keep the background readings short to help you keep up with them. We will discuss the readings in class, so come prepared with any questions you have. Please also come see me during my office hours if you would like to discuss the readings.

Hardware and Software Requirements

There are no specific computer requirements for the course. You may use your laptop in class for taking notes and accessing course materials if you would like.

Course Requirements

Assessments

Grades will be based on a combination of exams, class participation, and lab activities. These assessments are designed to provide you with an opportunity to use what you've learned in class and in the lab to make arguments based on evidence, to take a stance on debates in the field, and to demonstrate your technical skills. Grades will be based on points earned for each assessment. If you have any concerns about meeting the requirements for any component of the course, please let me know so we can discuss it.

Assessment Points Grade percentage
Exams (50%) Midterm 1 50 pts 12.5%
Midterm 2 50 pts 12.5%
Final exam (cumulative) 100 pts 25%
Participation (20%) Student-led discussion 60 pts 15%
Response journal 20 pts 5%
Lab activities (30%) Lab reports 78 pts 19.5%
Final project 42 pts 10.5%

Grading Scale

A-...90.00-93.32% A...>93.32%
B-...80.00-83.32% B...83.33-86.66% B+...86.67-89.99%
C-...70.00-73.32% C...73.33-76.66% C+...76.67-79.99%
D-...60.00-63.32% D...63.33-66.66% D+...66.67-69.99%
F...<60.00%

Exams

There will be three exams (two non-cumululative midterms and a cumulative final exam). The goal of the exams is to demonstrate your understanding of the concepts covered in class, apply the scientific principles you have learned, and take a stance on current debates in the field, backing up your claims with evidence. Questions will be drawn from material presented in class discussions and lab, as well as material presented in articles and background readings. Additional details about the format of the exams will be presented in class.

You may request a make-up exam if you have an authorized University absence/ Excused absences are described in the University's official Attendance Policy. Please speak to me in person if you have an authorized absence that requires you to make-up a scheduled exam.

Participation

Format of the class. The classroom component of the course is discussion-based. As a result, you will get the most out of the course if you keep up with the readings and come to class ready to participate. These discussions form the core of the course, and notes from class and group meetings will be used as the basis for exams. Therefore, it is very important to keep up with the readings and attend all class sessions. Please arrive on time and contribute to class discussions and activities. If you must miss class, I will be happy to meet with you to go over any material you would like. Just send me a message.

Student-led discussions. Each discussion will be led by myself and several student experts (that's you!). You will have an opportunity to select which topics you would like to lead the discussion of on the first day of class. You do not need to meet with the other discussion leaders before class (but you are welcome to if you want!). Each student should be prepared to contribute to the discussion of the reading, including experiments described in the reading, as well as how the data fit with one or more broader theories of speech perception and language processing. Each discussion leader should contribute to presenting their thoughts and guiding the discussion in their group and in class. Everyone else is encouraged to participate in the discussion as well. It's okay if there are things in the reading you don't understand—that's why we discuss the material together. I am also happy to meet with you before class to answer any questions. If you must miss class for some reason on a day you are scheduled to lead discussion, please meet with me to make up the work.

Journals. One of the key themes of this class is learning to ask and answer questions scientifically. In addition to asking questions in our class discussions, another way to practice this skill is with a response journal. I will leave a few minutes at the end of each class to complete this assignment. You may be asked to respond to specific questions, to summarize the key points of that day's class, or to discuss questions you still have on the topic. I will review the journals before each class, and we will have an opportunity to discuss any questions you had at the beginning of the next class.

Lab assignments

There will be regular laboratory meetings during the semester. These meetings are designed to give you hands-on experience with the tools used by scientists to study speech. There will be a series of lab exercises that you will complete over the course of the semester, as well as a final project. Details for each lab exercise will be given in laboratory meetings and will be available on the course website. The exercises are designed to build on each other, so the techniques you learn from the first exercise will be useful for the second one, and so on. Ultimately, the skills you learn in the lab will be used to complete your final project.

Lab reports. Following each of the lab exercises, you will write a short lab report detailing what you found in the lab. Your lab report should be written as a summary of what you accomplished during the lab activity. It is purposefully left open-ended so that you can describe your results in the way you think is best. We will discuss how to write a lab report together in class.

Final lab project. The final project will combine what you have learned in class discussions with the skills covered in laboratory meetings throughout the semester. The goal of the final project is to use what you have learned to design, run, and analyze the results of a new experiment. This experiment can take many different forms. Examples will be provided, but you should feel free to think outside the box. Critically, you must: (1) base your experiment on some previous findings about the sounds of language, (2) present a clear hypothesis, (3) collect the data necessary to test your hypothesis, and (4) analyze and report the results. You will turn in a write-up of the experiment, and present your results to the class during the last week of the semester. More details on the project will be provided later in the semester.

Course Policies

Standard Villanova Course Policies

Course-specific Policies

Extra credit

You will receive an email about an opportunity for you to earn extra credit if you would like to participate in a research study as part of the course (please let me know if you do not receive the email by the end of the first week of classes). If you do not wish to participate in the study, you can also earn the extra credit by completing the assginment here: Extra credit assignment


Course Schedule

Note: SoHL = Sounds of Human Language background readings. Link to the entire book.

Lab reports are due one week after completing the lab activity.


Date Topic Reading Lab Assignments
8/24 Introduction SoHL: Research Methods No lab this week
8/29 Acoustics SoHL: Acoustics
Acoustics Demos
Slides for class
8/31 Phonetics SoHL: Phonetics
9/5 No class—Labor Day
9/7 Phonetics (continued) IPA chart with English examples
IPA transcription practice
Real-time MRI IPA chart
Speech synthesis demo
Lab 1 write-up due (Wednesday section)
9/12 Cross-linguistic Differences in Speech Tucker & Wright (2020) Lab 1 write-up due (Monday section)
9/14 Accents and Dialects SoHL: Variability in Speech
Clopper and Pisoni (2004)
NY Times Dialect Quiz
9/19 Accents and Dialects (continued) Purnell et al. (1999)
John Baugh TED Talk
9/21 Debate: Bilingual Advantage Marian and Shook (2012)
de Bruin et al. (2015)
Lab 2 write-up due (Wednesday section); Hillenbrand et al. (1995)
9/26 Unit 1 Summary and Exam Review Exam questions from Fall 2019 Lab 2 write-up due (Monday section); Hillenbrand et al. (1995)
9/28 EXAM 1 Lab 3 write-up due (Wednesday section)
10/3 Debate: Continuous vs. Categorical Perception SoHL: Categorical Perception Lab 3 write-up due (Monday section)
10/5 Context Effects SoHL: Context Effects Lab 4 write-up due (Wednesday section)
10/10 No class—Fall Break
10/12 No class—Fall Break
10/17 Context Effects (continued) Strand & Johnson (1996) Lab 4 write-up due (Monday section)
10/19 Debate: Bottom-up vs. Top-down Processing McClelland et al. (2006)
McQueen et al. (2006)
Yanny/Laurel Illusion
Lab 5 write-up due (Wednesday section)
10/24 Models of Speech Perception SoHL: Models of Speech Perception Lab 5 write-up due (Monday section)
10/26 Automatic Speech Recognition Koenecke et al. (2020)
10/31 Speech and the Brain SoHL: Neurobiology of Speech Perception
11/2 Guest lecture: Dr. McCall Sarrett McMurray et al. (2022) [optional]
11/7 Unit 2 Summary and Exam Review Exam 2 questions from Fall 2019
11/9 EXAM 2
11/14 Speech and Language Development SoHL: Speech Development
Shneidman & Goldin-Meadow (2012)
11/16 Guest lecture: Grace Gervino John Hendrickson video
Myths about stuttering
11/21 Guest lecture: MSE Postdoctoral Fellow Candidate
11/22 Guest lecture: MSE Postdoctoral Fellow Candidate
11/23 No class—Thanksgiving Break
11/28 Hearing Loss SoHL: Hearing Loss;
Slides from class
11/30 Debate: Language Processing in Deaf and Hearing Subjects Neville et al. (1998)
Hickok et al. (1998)
12/5 Final Project Presentations Monday lab: Final project write-up due; Exam 2 Bonus Questions due
12/7 Final Project Presentations Wednesday lab: Final project write-up due
12/12 Guest lecture: MSE Postdoctoral Fellow Candidate
Unit 3 Summary and Exam Review
12/16, 2:30pm-5:00pm FINAL EXAM Final Exam questions from Fall 2019

Lab Schedule

Lab Activity Topic Dates
Lab 1 Acoustic Analysis (Instructions) 8/29 (Monday), 8/31 (Wednesday)
Lab 2 Vowel Measurement and Synthesis (Week 1 Instructions, Week 2 Instructions) 9/7 and 9/14 (Wednesday), 9/12 and 9/19 (Monday)
Lab 3 Cross-Splicing Speech Sounds (Instructions) 9/21 (Wednesday), 9/26 (Monday)
Lab 4 Categorical Perception Experiment (Instructions) 9/28 (Wednesday), 10/3 (Monday)
Lab 5 Statistical Analysis (Instructions) 10/5 (Wednesday), 10/17 (Monday)
Lab 6 EEG Experiment (Instructions) Different weeks depending on group, 10/19 - 11/30
Final Project Students choose their topic 10/19 - 11/30