What is the most common form of sociological research

Learning Outcomes

  • Describe how sociologists utilize surveys

Show

As a research method, a survey collects data from subjects who respond to a series of questions about behaviors and opinions, often in the form of a questionnaire, but surveys can also take the form of interviews with open-ended questions and/or closed-ended questions. The survey is the most widely used scientific research method in sociology. The standard survey format allows individuals a level of anonymity in which they can express personal ideas. Surveys might seem innocuous. How could someone be harmed with a survey? However, as with all types of sociological research, sociologists must obtain approval from a review board (sometimes called an Internal Review Board or IRB) before they commence any type of sociological survey if it is to be used for research purposes. If a professor asks students to complete a survey that asks about previous experience in an online class for the purpose of understanding students’ prior knowledge, that would not be considered research and would not require IRB approval. If a faculty member wants to use the results of the research for a academic publication, it would require IRB approval as well as some additional precautions (i.e., a detailed informed consent) since the faculty member is utilizing current students for research purposes.

What is the most common form of sociological research

Figure 1. Questionnaires are a common research method; the U.S. Census is a well-known example. (Photo courtesy of Kathryn Decker/flickr)

At some point, most people in the United States respond to some type of survey. The U.S. Census is an excellent example of a large-scale survey intended to gather sociological data. Not all surveys are considered sociological research, however, and many surveys we encounter focus on identifying marketing needs and strategies rather than testing a hypothesis or contributing to social science knowledge. Questions such as, “How many hot dogs do you eat in a month?” or “Were the staff helpful?” are not usually designed as scientific research. Often, polls on television do not reflect a general population, but are merely answers from a specific show’s audience. Polls conducted by programs such as American Idol or So You Think You Can Dance represent the opinions of fans, but are not particularly scientific. A good contrast to these are the Nielsen Ratings, which determine the popularity of television programming through objective scientific market research.

Sociologists conduct surveys under controlled conditions for specific purposes. Surveys gather different types of information from people. While surveys are not great at capturing the ways people really behave in social situations, they are an effective method for discovering how people feel and think—or at least how they say they feel and think. Surveys can track political preferences, or patterns in reported individual behaviors (such as sleeping, driving, or texting habits), or can gather factual information on subjects like employment status, income, and education levels.

A survey targets a specific population, people who are the focus of a study, such as college athletes, international students, or teenagers living with type 1 (juvenile-onset) diabetes. Most researchers choose to survey a small sector of the population, or a sample: that is, a manageable number of subjects who represent a larger population. The success of a study depends on how well a population is represented by the sample. In a random sample, every person in a population has the same chance of being chosen for the study. According to the laws of probability, random samples represent the population as a whole. For instance, a Gallup Poll, if conducted as a nationwide random sampling, should be able to provide an accurate estimate of public opinion using a relatively small sample. For polls focused on U.S. issues, a random sample of 1,000 is representative of the opinions of 230 million adults with a +/- 4 percentage points of accuracy. For world polls, involving 180 countries and 160 different languages utilize similar sample sizes. It’s amazing, isn’t it?

After selecting subjects, the researcher develops a specific plan to ask questions and record responses. It is important to inform subjects of the nature and purpose of the study up front. If they agree to participate, researchers thank subjects and offer them a chance to see the results of the study if they are interested. The researcher presents the subjects with an instrument, which is a means of gathering the information. A common instrument is a questionnaire, in which subjects answer a series of questions. For some topics, the researcher might ask yes-or-no or multiple-choice questions, allowing subjects to choose possible responses to each question. These quantitative data—research collected in numerical form that can be counted—are easy to tabulate. Just count up the number of “yes” and “no” responses or correct/incorrect answers, and chart them into percentages.

Questionnaires can also ask more complex questions with more complex answers. They can go beyond “yes” and “no,” or can offer a range of options next to a checkbox. In those cases, the answers are subjective and vary from person to person. How do you plan to use your college education? Why do you follow Jimmy Buffett around the country and attend every one of his concerts? Those types of questions require short essay responses, and participants willing to take the time to write those answers will convey personal information about religious beliefs, political views, and morals. Some topics that reflect internal thought are impossible to observe directly and are difficult to discuss honestly in a public forum. People are more likely to share honest answers if they can respond to questions anonymously. This type of information is qualitative data—results that are subjective and often based on what is seen in a natural setting. Qualitative information is harder to organize and tabulate. The researcher will end up with a wide range of responses, some of which may be surprising. The benefit of written opinions, though, is the wealth of material that they provide.

An interview is a one-on-one conversation between the researcher and the subject, and it is a way of conducting surveys on a topic. Interviews are similar to the short-answer questions on surveys in that the researcher asks subjects a series of questions. However, participants are free to respond as they wish, without being limited by predetermined choices. In the back-and-forth conversation of an interview, a researcher can ask for clarification, spend more time on a subtopic, or ask additional questions. In an interview, a subject will ideally feel free to open up and answer questions that are often more complex. There are no right or wrong answers. The subject might not even know how to answer the questions honestly.

Questions such as “How did society’s view of alcohol consumption influence your decision whether or not to take your first sip of alcohol?” or “Did you feel that the divorce of your parents would put a social stigma on your family?” involve so many factors that the answers are difficult to categorize. A researcher needs to avoid steering or prompting the subject to respond in a specific way; otherwise, the results will prove to be unreliable. And, obviously, a sociological interview is not an interrogation. The researcher will benefit from gaining a subject’s trust, from empathizing or commiserating with a subject, and from listening without judgment.

Think It Over

  • What type of data do surveys gather? For what topics would surveys be the best research method? What drawbacks might you expect to encounter when using a survey? To explore further, ask a research question and write a hypothesis. Then create a survey of about six questions relevant to the topic. Provide a rationale for each question. Now define your population and create a plan for recruiting a random sample and administering the survey.

Practice differentiating between qualitative and quantitative surveys in the following interactive.

interview: a one-on-one conversation between the researcher and the subject population: a defined group serving as the subject of a study quantitative data: represent research collected in numerical form that can be counted qualitative data: comprise information that is subjective and often based on what is seen in a natural setting random sample: a study’s participants being randomly selected to serve as a representation of a larger population samples: small, manageable number of subjects that represent the population surveys: collect data from subjects who respond to a series of questions about behaviors and opinions, often in the form of a questionnaire

Did you have an idea for improving this content? We’d love your input.

  1. List the major advantages and disadvantages of surveys, experiments, and observational studies.

We now turn to the major methods that sociologists use to gather the information they analyze in their research. Table 2.2 “Major Sociological Research Methods” summarizes the advantages and disadvantages of each method.

Table 2.2 Major Sociological Research Methods

Method Advantages Disadvantages
Survey Many people can be included. If given to a random sample of the population, a survey’s results can be generalized to the population. Large surveys are expensive and time consuming. Although much information is gathered, this information is relatively superficial.
Experiments If random assignment is used, experiments provide fairly convincing data on cause and effect. Because experiments do not involve random samples of the population and most often involve college students, their results cannot readily be generalized to the population.
Observation (field research) Observational studies may provide rich, detailed information about the people who are observed. Because observation studies do not involve random samples of the population, their results cannot readily be generalized to the population.
Existing data Because existing data have already been gathered, the researcher does not have to spend the time and money to gather data. The data set that is being analyzed may not contain data on all the variables in which a sociologist is interested or may contain data on variables that are not measured in ways the sociologist prefers.

The survey is the most common method by which sociologists gather their data. The Gallup Poll is perhaps the best-known example of a survey and, like all surveys, gathers its data with the help of a questionnaire that is given to a group of respondents. The Gallup Poll is an example of a survey conducted by a private organization, but it typically includes only a small range of variables. It thus provides a good starting point for research but usually does not include enough variables for a full-fledged sociological study. Sociologists often do their own surveys, as does the government and many organizations in addition to Gallup.

The General Social Survey, described earlier, is an example of a face-to-face survey, in which interviewers meet with respondents to ask them questions. This type of survey can yield a lot of information, because interviewers typically will spend at least an hour asking their questions, and a high response rate (the percentage of all people in the sample who agree to be interviewed), which is important to be able to generalize the survey’s results to the entire population. On the downside, this type of survey can be very expensive and time-consuming to conduct.

Because of these drawbacks, sociologists and other researchers have turned to telephone surveys. Most Gallup Polls are conducted over the telephone. Computers do random-digit dialing, which results in a random sample of all telephone numbers being selected. Although the response rate and the number of questions asked are both lower than in face-to-face surveys (people can just hang up the phone at the outset or let their answering machine take the call), the ease and low expense of telephone surveys are making them increasingly popular.

Mailed surveys, done by mailing questionnaires to respondents, are still used, but not as often as before. Compared with face-to-face surveys, mailed questionnaires are less expensive and time consuming but have lower response rates, because many people simply throw out the questionnaire along with other junk mail.

Whereas mailed surveys are becoming less popular, surveys done over the Internet are becoming more popular, as they can reach many people at very low expense. A major problem with Web surveys is that their results cannot necessarily be generalized to the entire population, because not everyone has access to the Internet.

Experiments are the primary form of research in the natural and physical sciences, but in the social sciences they are for the most part found only in psychology. Some sociologists still use experiments, however, and they remain a powerful tool of social research.

The major advantage of experiments is that the researcher can be fairly sure of a cause-and-effect relationship because of the way the experiment is set up. Although many different experimental designs exist, the typical experiment consists of an experimental group and a control group, with subjects randomly assigned to either group. The researcher makes a change to the experimental group that is not made to the control group. If the two groups differ later in some variable, then it is safe to say that the condition to which the experimental group was subjected was responsible for the difference that resulted.

Most experiments take place in the laboratory, which for psychologists may be a room with a one-way mirror, but some experiments occur in “the field,” or in a natural setting. In Minneapolis, Minnesota, in the early 1980s, sociologists were involved in a much-discussed field experiment sponsored by the federal government. The researchers wanted to see whether arresting men for domestic violence made it less likely that they would commit such violence again. To test this hypothesis, the researchers had police do one of the following after arriving at the scene of a domestic dispute: they either arrested the suspect, separated him from his wife or partner for several hours, or warned him to stop but did not arrest or separate him. The researchers then determined the percentage of men in each group who committed repeated domestic violence during the next 6 months and found that those who were arrested had the lowest rate of recidivism, or repeat offending (Sherman & Berk, 1984). This finding led many jurisdictions across the United States to adopt a policy of mandatory arrest for domestic violence suspects. However, replications of the Minneapolis experiment in other cities found that arrest sometimes reduced recidivism for domestic violence but also sometimes increased it, depending on which city was being studied and on certain characteristics of the suspects, including whether they were employed at the time of their arrest (Sherman, 1992).

As the Minneapolis study suggests, perhaps the most important problem with experiments is that their results are not generalizable beyond the specific subjects studied. The subjects in most psychology experiments, for example, are college students, who are not typical of average Americans: they are younger, more educated, and more likely to be middle class. Despite this problem, experiments in psychology and other social sciences have given us very valuable insights into the sources of attitudes and behavior.

Observational research, also called field research, is a staple of sociology. Sociologists have long gone into the field to observe people and social settings, and the result has been many rich descriptions and analyses of behavior in juvenile gangs, bars, urban street corners, and even whole communities.

Observational studies consist of both participant observation and nonparticipant observation. Their names describe how they differ. In participant observation, the researcher is part of the group that she or he is studying. The researcher thus spends time with the group and might even live with them for a while. Several classical sociological studies of this type exist, many of them involving people in urban neighborhoods (Liebow, 1967, 1993; Whyte, 1943). Participant researchers must try not to let their presence influence the attitudes or behavior of the people they are observing. In nonparticipant observation, the researcher observes a group of people but does not otherwise interact with them. If you went to your local shopping mall to observe, say, whether people walking with children looked happier than people without children, you would be engaging in nonparticipant observation.

A related type of research design is intensive interviewing. Here a researcher does not necessarily observe a group of people in their natural setting but rather sits down with them individually and interviews them at great length, often for one or two hours or even longer. The researcher typically records the interview and later transcribes it for analysis. The advantages and disadvantages of intensive interviewing are similar to those for observational studies: intensive interviewing provides much information about the subjects being interviewed, but the results of such interviewing cannot necessarily be generalized beyond the subjects.

A classic example of field research is Kai T. Erikson’s Everything in Its Path (1976), a study of the loss of community bonds in the aftermath of a flood in a West Virginia mining community, Buffalo Creek. The flood occurred when an artificial dam composed of mine waste gave way after days of torrential rain. The local mining company had allowed the dam to build up in violation of federal law. When it broke, 132 million gallons of water broke through and destroyed several thousand homes in seconds while killing 125 people. Some 2,500 other people were rendered instantly homeless. Erikson was called in by the lawyers representing the survivors to document the sociological effects of their loss of community, and the book he wrote remains a moving account of how the destruction of the Buffalo Creek way of life profoundly affected the daily lives of its residents.

Similar to experiments, observational studies cannot automatically be generalized to other settings or members of the population. But in many ways they provide a richer account of people’s lives than surveys do, and they remain an important method of sociological research.

Sometimes sociologists do not gather their own data but instead analyze existing data that someone else has gathered. The U.S. Census Bureau, for example, gathers data on all kinds of areas relevant to the lives of Americans, and many sociologists analyze census data on such topics as poverty, employment, and illness. Sociologists interested in crime and the legal system may analyze data from court records, while medical sociologists often analyze data from patient records at hospitals. Analysis of existing data such as these is called secondary data analysis. Its advantage to sociologists is that someone else has already spent the time and money to gather the data. A disadvantage is that the data set being analyzed may not contain data on all the variables in which a sociologist may be interested or may contain data on variables that are not measured in ways the sociologist might prefer.

Nonprofit organizations often analyze existing data, usually gathered by government agencies, to get a better understanding of the social issue with which an organization is most concerned. They then use their analysis to help devise effective social policies and strategies for dealing with the issue. The “Learning From Other Societies” box discusses a nonprofit organization in Canada that analyzes existing data for this purpose.

Social Research and Social Policy in Canada

In several nations beyond the United States, nonprofit organizations often use social science research, including sociological research, to develop and evaluate various social reform strategies and social policies. Canada is one of these nations. Information on Canadian social research organizations can be found at http://www.canadiansocialresearch.net/index.htm.

The Canadian Research Institute for Social Policy (CRISP) at the University of New Brunswick is one of these organizations. According to its Web site (http://www.unb.ca/crisp/index.php), CRISP is “dedicated to conducting policy research aimed at improving the education and care of Canadian children and youth…and supporting low-income countries in their efforts to build research capacity in child development.” To do this, CRISP analyzes data from large data sets, such as the Canadian National Longitudinal Survey of Children and Youth, and it also evaluates policy efforts at the local, national, and international levels.

A major concern of CRISP has been developmental problems in low-income children and teens. These problems are the focus of a CRISP project called Raising and Leveling the Bar: A Collaborative Research Initiative on Children’s Learning, Behavioral, and Health Outcomes. This project at the time of this writing involved a team of five senior researchers and almost two dozen younger scholars. CRISP notes that Canada may have the most complete data on child development in the world but that much more research with these data needs to be performed to help inform public policy in the area of child development. CRISP’s project aims to use these data to help achieve the following goals, as listed on its Web site: (a) safeguard the healthy development of infants, (b) strengthen early childhood education, (c) improve schools and local communities, (d) reduce socioeconomic segregation and the effects of poverty, and (e) create a family enabling society (http://www.unb.ca/crisp/rlb.html). This project has written many policy briefs, journal articles, and popular press articles to educate varied audiences about what the data on children’s development suggest for child policy in Canada.

  • The major types of sociological research include surveys, experiments, observational studies, and the use of existing data.
  • Surveys are very common and allow for the gathering of much information on respondents that is relatively superficial. The results of surveys that use random samples can be generalized to the population that the sample represents.
  • Observational studies are also very common and enable in-depth knowledge of a small group of people. Because the samples of these studies are not random, the results cannot necessarily be generalized to a population.
  • Experiments are much less common in sociology than in psychology. When field experiments are conducted in sociology, they can yield valuable information because of their experimental design.

References

Erikson, K. T. (1976). Everything in its path: Destruction of community in the Buffalo Creek flood. New York, NY: Simon and Schuster.

Liebow, E. (1967). Tally’s corner. Boston, MA: Little, Brown.

Liebow, E. (1993). Tell them who I am: The lives of homeless women. New York, NY: Free Press.

Sherman, L W. (1992). Policing domestic violence: Experiments and dilemmas. New York, NY: Free Press.

Sherman, L. W., & Berk, R. A. (1984). The specific deterrent effects of arrest for domestic assault. American Sociological Review, 49, 261–272.

Whyte, W. F. (1943). Street corner society: The social structure of an Italian slum. Chicago, IL: University of Chicago Press.