Analysis of Complex Survey Data (from NCES) 2024

SHORT COURSE DESCRIPTION

A wealth of publicly available national and international data exists for use by researchers in education and other social science disciplines. Of particular interest for this workshop are the data supplied by the National Center for Education Statistics (NCES) although the topics presented in this workshop generalize to other large-scale data collection. The goal of this workshop is to allow those researchers who are new to using national and international data to become more comfortable with accessing and appropriately analyzing the data. Of particular concern in analyzing public-release data from the NCES is that a complex probability sampling technique was used to obtain responses from participants. Such a sampling design requires the use of specialized statistics to obtain unbiased point estimates (e.g., means, regression coefficients, structural path estimates) and sampling variance estimates (e.g., standard errors). The aim of this workshop is to instruct researchers on best practices on working with these data.

 

DATES AND TIMES

Nov 7-8, 2024 (Thurs-Fri)

10am-5pm Eastern Standard Time (UTC-5)

The instructor will determine timing of breaks.

 

COURSE FEES

Professional: $375

Full-time student*: $195

 

*Full-time students need to submit student status proof at https://go.umd.edu/CILVR-Student-24 to request a discount code prior to registration.

 

*Course fee will be waived for HDQM Department faculty and degree-seeking students, although the UMD IT department will charge you a tech fee to register ($10). HDQM department registrants can request the discount code by submitting the following form: https://go.umd.edu/CILVR-HDQM-24.

 

 

HOW TO REGISTER

 

Prior to registration, participants not affiliated with UMD need to get a valid UMD associate account in order to register for the short course and access the course content. Participants can visit https://identity.umd.edu/id/associate/registration to create an UMD associate account. For more details about the UMD associate account, please click here.

 

For UMD affiliated participants, you may register using your existing UMD directory ID. 

 

To request the promotional code prior to registration: 

- Full-time students can submit the student status proof at https://go.umd.edu/CILVR-Student-24 to request a student discount code prior to registration. Note that it may take 2-3 business days for your request to be processed.

- HDQM department registrants can request the HDQM discount code by submitting the following form: https://go.umd.edu/CILVR-HDQM-24. Note that it may take 2-3 business days for your request to be processed.

 

SCOPE OF SHORT COURSE

This short course is meant to introduce participants to the issues in working with national and international complex probability sample data sets, including both conceptual issues in measurement and setting up models as well as in the specialized statistical procedures required to conduct appropriate analyses. Participants will be presented with structured examples of downloading data and addressing the analytic challenges, as well as be given an opportunity to explore their own analyses with feedback from the instructor.  At the end of the short course, participants should be able to:

• Learn about and download public-release data from the National Center for Education Statistics
• Acknowledge the limitations in using these data for analyses, given constraints in measurement and the observational nature of survey data
• Describe the differences between the many types of weights available on the data set (e.g., sampling weights, panel weights, replicate weights)
• Undertake basic statistical analysis (descriptive analysis, t-tests, multiple regression), obtaining appropriate unbiased estimates and standard errors by using sampling weights and specialized variance estimation techniques (supported software for basic analysis will include SPSS, SAS, R, Stata, HLM, and Mplus)
• Recognize advanced issues that may need to be addressed, such as imputation methods for missing data and domain analysis for studies of subpopulations
• Identify advantages and disadvantages in utilizing multilevel models with these types of data

 

TARGET AUDIENCE

The target audience for this course is any individual with an intermediate knowledge of statistical analyses who seeks to conduct or understand the analysis of complex survey data. This population includes all levels of graduate students, assuming a basic knowledge of research design and statistical analysis. Researchers working within academic institutions or research agencies are the ideal audience. Other individuals may benefit from the course as well, especially if their work focuses on using extant data collected by the U.S. Education Department.

 

REQUISITE KNOWLEDGE

Required:

• Intermediate proficiency in a statistical programming language (e.g., SPSS, SAS, R, Stata, HLM, Mplus)
• Intermediate proficiency in inferential statistics

Not required but advantageous:

• Experience working with large datasets
• Knowledge of advanced statistical modeling (e.g., HLM, SEM)

No level of proficiency beyond basic awareness is assumed for skills related to:

• NCES
• Survey design and measurement

 

 

SOFTWARE

 

Examples and support will be provided for SPSS, R, SAS, Stata, HLM, and Mplus software packages.

 

 

LOCATION AND PLATFORM

 

• The course materials and meeting links will be posted on the course page through UMD Open Learning (https://umd.catalog.instructure.com/)
• This workshop will be delivered entirely online via the video conferencing software Zoom (https://zoom.us/).
• Within a limited time, the video recordings of the short course will be accessible for both synchronous and asynchronous participants on the course page.

 

 

SCHEDULE

 

The two-day workshop will entail a mix of synchronous and asynchronous work.  The tentative schedule for each day will be (all times EST): 

 

         10am-12pm  synchronous lecture

         12-1:00pm    asynchronous problem sets

         1-1:30pm      synchronous work through problem sets

         1:30-3:30      synchronous lecture with short break

         3:30-4:30      asynchronous problem sets

         4:30-5pm      synchronous work through problem sets.

 

*Please note that the schedule is only tentative and subject to change. 

 

 

IMPORTANT COURSE DETAILS

 

Platform: Participants need to have a valid UMD associate ID in order to register for the short course and access the course content. Participants can visit https://identity.umd.edu/id/associate/registration to create an UMD associate account. For more details please click here.

 

Format: Participants will receive a personalized login code to use on their own computer to access a reliable live-stream of the short course over Zoom, showing the instructor as well as the handouts.

 

Materials: Participants will receive electronic copies of the short course materials, as well as any other relevant materials or information.

 

Timing/access: Participants may choose to watch the stream synchronously, or may elect to watch a recording of the short course asynchronously, or both. Recordings will be available to participants for six months following the end of the short course. This is especially useful for on-line participants in different time zones who may choose to watch at some later time than (but within six months of) the actual short course time. (Asynchronous participation does not include real-time chat with other on-line participants, although a visual record of prior chats will be viewable).

 

Technical support: Participants are responsible for installing the conferencing software Zoom on their own electronic devices and for obtaining a Zoom account that allows the participant to join Zoom meetings and webinars hosted by external organizations. Participants are assumed to be able to secure a reliable computer, internet browser, and Wi-Fi connection. Challenges at the user end must be resolved by the user. Fortunately, because the short course is recorded, users experiencing technical challenges can still “catch up” by watching the recordings to which they have access.

 

Content support: During the lecture, real-time content support for on-line participants is mostly limited to real-time chat with the on-line (Zoom) participant community and any quantitative methodology doctoral students who might also be participating. Participants may have direct interactions with the instructor in some format during the practice sessions. On-line participants may e-mail the instructor for further content support that cannot be addressed in real-time.

 

THE INSTRUCTOR

Dr. Laura M. Stapleton is a Professor and Chair of the Department of Human Development and Quantitative Methodology at the University of Maryland, College Park. She has taught courses on multilevel modeling, causal inference, and the analysis of complex survey data at the University of Maryland and formerly taught structural equation modeling and survey research methods at the University of Texas at Austin. Dr. Stapleton has published several book chapters on analysis of data from complex sampling designs and has published methodological work in this area in professional journals, including Structural Equation Modeling and Multivariate Behavioral Research. She has been funded by an Institute of Education Sciences methodology grant to evaluate strategies for analyzing NCES data. She holds a B.A in Economics from the University of Michigan, an M.Ed. in Curriculum and Instruction from George Mason University and a Ph.D. in Measurement, Statistics and Evaluation from the University of Maryland. She may be reached at lstaplet@umd.edu.

 

REFUND POLICY

Full refund if cancellation occurs at least 10 business days prior to the workshop date; 50% refund if within 10 days of the first day of the course.

 

CONTACT

For any further questions, please contact Ashani Jayasekera at complexdata.cilvr@gmail.com.

 

CILVR Short Course Series

• Analysis of Complex Survey Data (from NCES)
• Introduction to Multilevel Modeling
• Structural Equation Modeling: From Beginner to Intermediate
• Introduction to Longitudinal Structural Equation and Latent Growth Modeling
• Item Writing and Questionnaire Design
• Introduction to Meta-Analysis
• Applied Causal Inference with Directed Acyclic Graphs
• Introduction to Social Network Analysis

 

Center for Integrated Latent Variable Research (CILVR) at the University of Maryland (UMD)

CILVR is a center whose goal is to serve as a national and international focal point for innovative collaboration, state-of-the-art training, and scholarly dissemination as they relate to the full spectrum of latent variable statistical methods. CILVR is housed within the Quantitative Methodology: Measurement and Statistics (QMMS) program in the Department of Human Development and Quantitative Methodology at the University of Maryland. QMMS faculty are recognized scholars in various facets of latent variable statistical models, whether it be item response theory, latent class analysis, mixture models, latent growth models, or structural equation modeling.