7 min readโขdecember 31, 2020

Jerry Kosoff

FRQ practice is one of the most important ways to prepare for the exam! Sudent writing practice samples and corresponding feedback from Fiveable teacher Jerry Kosoff.

A large university offers undergraduate courses both in-person on its campus and digitally through an online platform. The administration of the university wishes to gauge their studentsโ opinions about the quality of teaching at the university; specifically, they want to estimate the proportion of all students who would agree that they are receiving good instruction. They are considering several methods for collecting this data.

- One method they are considering is conducting a simple random sample. The university has 30,000 students, and the administrators wish to ask a sample of 500 students for their opinion of the quality of teaching. Describe a procedure for how the administrators could conduct a simple random sample in this situation.
- A faculty member of the statistics department suggests to the administrators that they may want to consider a stratified random sample, using the primary type of instruction a student receives (in-person or digitally) as a variable for stratification. Describe in the context of the scenario why a stratified random sample may provide a more precise estimate of the proportion of all students who would agree that they are receiving good instruction than the simple random sampling method you detailed in #1.

- Write the names of all 30,000 students on equal sized pieces of paper and put in a hat. Shake the hat. Then choose 500 pieces of paper out of the hat without replacement and collect the data they need.
- In a stratified random sample, you are guaranteed to get results from students who receive instruction online and in person. In a random sample, you have the ability to possibly get students from only in school or only online instruction. With a stratified random sample, youโd sort the students based on how they receive their instruction content. Then write down the names of each student in each strata on equal sized pieces of paper and place in a hat. Shake the hat. Then choose 250 students from the digital hat and 250 students from the in person hat and study their results. This will ensure that both populations of interest are being examined.

FRQ teacher feedback:

For #1, your use of the โnames in a hatโ method of conducting an SRS is clear, but stumbles a bit at the end: โcollect the data they needโ is a little vague and doesnโt connect to this scenario. It should be clear that the 500 pieces of paper representยstudentsย (you do this in your first sentence) and that the selected students will be given the survey about quality of instruction. That second part isnโt clear in your response. On some rubrics, your response would still earn โEโ (full credit); on others, it may be in jeopardy of being bumped to a โPโ (partial credit)

For #2, you do a good job of explaining one purpose of a stratified sample (you are guaranteed to get results from each type of student), how that differs from an SRS (you might only get one group or the other), but then you describe how toยimplementย the stratified sample. That wasnโt what the question asked: they want to knowยwhyย the stratified sample is a good idea. The beginning of your answer starts down that road, but should go a little further in describing the fact that having results from the two different groups of students is goodยbecause their opinions about the quality of instruction may differ, which is the intent of the survey. Therefore, your response would likely get partial credit (โPโ)

- The administrators would randomly number the 30,000 students an integer between 1 and 30,000. Then, the students with the numbers 1-500 would be the sample of 500 students who would be asked about the opinion of the quality of teaching.
- Since studentsโ opinions of their quality of teaching might be similar within their primary type of instruction, the primary type of instruction a student receives (in-person or digitally) should be used as a variable for stratification. Stratification by the primary type of instruction should result in more precise estimates of student opinion than a simple random sample of the same size as there will be much less variability.

FRQ teacher feedback:

For part #1, Iโm a little torn on whether you would earn โEโ or โPโ. Typically, the criteria for describing implementing a process like this are (1) clearly assign numbers to each individual, (2) generate a list ofยnย unique numbers within the boundaries of the assigned numbers, (3) select individuals who correspond with the numbers. It is clear that you have fulfilled components (2) and (3)โฆ what Iโm stuck on is (1). Saying โrandomly number the 30,000 students [with] an integer between 1 and 30,000โ does not clearly indicate that each student is receiving a unique number label; your description being just โrandomlyโ leaves open the possibility of multiple people being assigned the same number, for example. This can be alleviated by using a clear randomization method. For example, you could have said โFrom a list of the 30,000 students, randomize the order of names and then assign the first name on the list 1, second name 2, and so on until all students are numbered. [rest of your response here]โ. Or - and hereโs the annoying part - simply add the word โuniqueโ before โinteger between 1 and 30,000โ, and youโre covered. So with all of that said (sorry for long-winded response), youโd likely earn โPโ for this part.

Much shorter feedback for #2: you crushed it. You show a clear understanding ofยwhyย stratification is useful in this context, and gave a reason why (โopinionsโฆ might be similar within their primary type of instructionโ). โEโ for this part!

- The administrators could conduct a simple random sample in this situation by randomly assigning the students a number from 1-30,000 (only 1 number per student). They can use a random number generator to select 500 students without replacement who can be asked for their opinion of the quality of teaching at the university.
- A stratified random sample may provide a more precise estimate of the proportion of all students who would agree that they are receiving good instruction than the SRS method in part (a). Because the variable for stratification is either if the student receives in-person or digital instruction, the spread of the data will be less (or less variability)

FRQ teacher feedback:

For #1, your response is strong, but missing one small component: when you use the RNG to select 500 students without replacement (as you should), you must specify that you want the RNG to select 500 numbersยwithin the range of 1-30,000. The way youโve described it leaves us open to the possibility that 500 numbers will be generated, but not all 500 numbers will match the labels of students. Yes, itโs a small detail, but itโs been a part of rubrics for this type of question in the past. (The 3 things that are usually looked for: (1) give the population unique numbers, (2) generateยnย unique numbers within the range of the numbers from the population, (3) choose the [individuals] corresponding to those numbers and administer [thing].) Your response clearly does 2 of those 3 things, and would likely earn partial instead of full credit.

For #2, your response essentially summarizes the question (weโll provide a more precise estimate of the proportion), without fully explainingยwhyย that happens. You mention that there will be โless variabilityโ, but do not mention how stratifying the sample will do that. When explaining why we stratify (or block in experiments), itโs important to connect to the stratification/blocking variable to the response variable: in this case, that means explaining that the type of instruction a student receives may impact their opinion of the quality of that instruction (then insert a possible reason for this), which is why stratifying might help reduce variation: weโll have separated the sample based on a factor that would influence the response, making our estimate more representative of the true population proportion.

- The administrators should conduct a simple random sample by randomly assigning each student a unique number from 1-30,000. Then the administrators can use a random number generator and choose 500 numbers within the range of 1-30,000. The chosen 500 numbers would then represent the sample of 500 students who would be asked for their opinion of the quality of teaching by the administrators.
- The stratified random sample may provide a more precise estimate of the proportion of all students who would agree that they are receiving good instruction than the SRS method because students who receive in-person instruction may enjoy the instruction more that the people who receive online lectures. Therefore, the type of instruction received will influence a studentโs response to the administratorโs question. Thus, the type of instruction received will be a confounding variable and result in variability in responses. To reduce variability, stratification of the type of instruction received will result in more precise estimates of students who agree they are receiving good instruction.

FRQ Teacher Feedback

Very well done! For #1, you check all of the boxes that we as readers must look for - each individual is given aยuniqueย number, the numbers you generate are within the bounds of the numbers you assign, and you clearly indicate what is being done with the individuals selected.

For #2, you give a clear description of why stratification is done, in the context of the scenario. Nicely done!

Browse Study Guides By Unit

๐Unit 1 โ Exploring One-Variable Data

โ๏ธUnit 2 โ Exploring Two-Variable Data

๐Unit 3 โ Collecting Data

๐ฒUnit 4 โ Probability, Random Variables, & Probability Distributions

๐Unit 5 โ Sampling Distributions

โ๏ธUnit 6 โ Proportions

๐ผUnit 7 โ Means

โณ๏ธUnit 8 โ Chi-Squares

๐Unit 9 โ Slopes

โ๏ธFrequently Asked Questions

๐Study Tools

๐คExam Skills

ยฉ 2024 Fiveable Inc. All rights reserved.