Occupation is a construct prone to classification mismatches by coders and description inconsistency by respondents. We explore whether mismatches in occupational coding have recently increased, what factors are associated with the rise in mismatches, and how the rise affects estimates of intragenerational occupational mobility. Utilizing the 1991–2020 Annual Social and Economic Supplement of the Current Population Survey, which collects information on respondents’ current occupation and the previous year’s main occupation, we identify coding mismatches and compare the probabilities of occupational mobility based on four combinations of two variables. Our results show that not only do the estimates of occupational mobility between two adjacent years vary substantially across measures, but also that the magnitudes of intragenerational occupational mobility across measures become increasingly decoupled over time. We demonstrate that the likely cause of this divergence is the rise in coding mismatches between coders. We discuss the implications of our findings.
AbrevayaJ.HausmanJ. A.. 1999. “Semiparametric Estimation with Mismeasured Dependent Variables: An Application to Duration Models for Unemployment Spells.” Annales d’Économie et de Statistique 55/56: 243–75.
2.
AutorD. H.DornD.. 2013. “The Growth of Low-Skill Service Jobs and the Polarization of the US Labor Market.” American Economic Review103: 1553–97.
3.
Avent-HoltD.HenriksenL. F.HägglundA. E.JungJ.KodamaN.MelzerS. M.MunE.RaineyA.Tomaskovic-DeveyD.. 2020. “Occupations, Workplaces or Jobs? An Exploration of Stratification Contexts Using Administrative Data.” Research in Social Stratification and Mobility70: 100456.
4.
BabbieE. R.2020. The Practice of Social Research. 15th ed. Boston, MA: Cengage.
5.
BelloniM.BrugiaviniA.MeschiE.TijdensK.. 2016. “Measuring and Detecting Errors in Occupational Coding: An Analysis of SHARE Data.” Journal of Official Statistics32: 917–45.
6.
BernhardtR.MunroD.WolcottE.. 2021. “How Does the Dramatic Rise of CPS Non-Response Impact Labor Market Indicators?.” GLO Discussion Paper Series781.
7.
BiemerP. P.LybergL. E.. 2003. Introduction to Survey Quality. Hoboken, NJ: Wiley & Sons, Inc.
8.
BlauP. M.DuncanO. D.. 1967. The American Occupational Structure. New York, NY: Wiley.
9.
CampanelliP. 1997. “Testing Survey Questions: New Directions in Cognitive Interviewing.” Bulletin of Sociological Methodology55: 5–17.
10.
Census. 2019. “The Alphabetical Indexes of Industries and Occupations.” United States Census Bureau.
11.
ChengS.ParkB.. 2020. “Flows and Boundaries: A Network Approach to Studying Occupational Mobility in the Labor Market.” American Journal of Sociology126: 577–631.
12.
ConradF. G.CouperM. P.SakshaugJ. W.2016. “Classifying Open-Ended Reports: Factors Affecting the Reliability of Occupation Codes.” Journal of Official Statistics32: 75–92.
13.
DuncanO. D.1961. “A Socioeconomic Index for All Occupations.” Pp.109–138 in Occupations and Social Status, edited by ReisA. J.. New York, NY: Free Press of Glencoe.
14.
EliasP.1997. “Occupational Classification (ISCO-88): Concepts, Methods, Reliability, Validity and Cross-National Comparability. OECD Labour Market and Social Policy Occasional Papers 20.
15.
EllisonR. 2014. “CASCOT and the Coding of Occupations in European Surveys.” Technical report, Amsterdam, the Netherlands.
16.
EriksonR.GoldthorpeJ. H.PortocareroL.. 1979. “Intergenerational Class Mobility in Three Western European Societies: England, France and Sweden.” British Journal of Sociology30: 415–41.
17.
FloodS.KingM.RodgersR.RugglesS.WarrenJ.R.. 2020. “Integrated Public Use Microdata Series, Current Population Survey: Version 8.0 [Dataset].” Minneapolis, MN: University of Minnesota.
18.
GanzeboomH. B. G. 2010. “With Special Reference to the International Standard Classification of Occupations ISCO-88 with an Extension on ISCO-08.” Working Paper.
19.
GweonH.SchonlauM.KaczmirekL.BlohmM.SteinerS.. 2017. “Three Methods for Occupation Coding Based on Statistical Learning.” Journal of Official Statistics33: 101–22.
20.
Halpern-MannersA.WarrenJ. R.. 2012. “Panel Conditioning in Longitudinal Studies: Evidence from Labor Force Items in the Current Population Survey.” Demography49: 1499–519.
21.
HauserR. M.WarrenJ. R.. 1997. “Socioeconomic Indexes for Occupations: A Review, Update, and Critique.” Sociological Methodology27: 177–298.
22.
HausmanJ. A.AbrevayaJ.Scott-MortonF. M.. 1998. “Misclassification of the Dependent Variable in a Discrete-Response Setting.” Journal of Econometrics87: 239–69.
23.
HelgertzS. R.WarrenJ. R.FitchC. A.GoekenR.HackerJ. D.NelsonM. A.PriceJ. P.RobertsE.SobekM.. 2020. “IPUMS Multigenerational Longitudinal Panel: Version 1.0 [Dataset].” Minneapolis, MN: University of Minnesota. https://doi.org/10.18128/D016.V1.0.
24.
HénautL.LenaJ. C.AccominottiF.. 2023. “Polyoccupationalism: Expertise Stretch and Status Stretch in the Postindustrial Era.” American Sociological Review88: 872–900.
25.
HokayemC.BollingerC.ZiliakJ. P.2015. “The Role of CPS Nonresponse in the Measurement of Poverty.” Journal of the American Statistical Association110: 935–45.
26.
HouseworthC.FisherJ.. 2020. “Measurement Error in Occupation and the Impact on Intergenerational Mobility.” Research in Social Stratification and Mobility70: 100469.
27.
HoutM.HastingsO. P.2016. “Reliability of the Core Items in the General Social Survey: Estimates from the Three-Wave Panels, 2006–2014.” Sociological Science3: 971–1002.
28.
IkudoA.LaneJ. I.StaudtJ.WeinbergB. A.2019. “Occupational Classifications: A Machine Learning Approach.” Journal of Economic and Social Measurement44: 57–87.
29.
International Labour Office. 2012. International Standard Classification of Occupations 2008 (ISCO-08): Structure, Group Definitions and Correspondence Tables. Geneva: International Labour Office.
30.
JarvisB. F.SongX.. 2017. “Rising Intragenerational Occupational Mobility in the United States, 1969 to 2011.” American Sociological Review82: 568–99.
31.
JerryH.2001. “Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left.” Journal of Economic Perspectives15: 57–67.
32.
KallebergA. L.MouwT.. 2018. “Occupations, Organizations, and Intragenerational Career Mobility.” Annual Review of Sociology44: 283–303.
33.
KambourovG.ManovskiiI.. 2008. “Rising Occupational and Industry Mobility in the United States: 1968–97.” International Economic Review49: 41–79.
34.
KambourovG.ManovskiiI.. 2013. “A Cautionary Note on Using (March) Current Population Survey and Panel Study of Income Dynamics Data to Study Worker Mobility.” Macroeconomic Dynamics17: 172–94.
35.
KanM. Y.PudneyS.2008. “Measurement Error in Stylized and Diary Data on Time Use.” Sociological Methodology38: 101–32.
KimY.-M.2013b. “Diverging Top and Converging Bottom: Labour Flexibilization and Changes in Career Mobility in the USA.” Work, Employment and Society27: 860–79.
38.
KimC. H.KimJ.BanM.. 2020. “Do You Know What You Do for a Living? Occupational Coding Mismatches between Coders in the Korean General Social Survey.” Research in Social Stratification and Mobility70: 100467.
39.
KimC. H.TamboriniC. R.2014. “Response Error in Earnings: An Analysis of the Survey of Income and Program Participation Matched with Administrative Data.” Sociological Methods & Research43: 39–72.
40.
KimC. H.TamboriniC. R.SakamotoA.. 2018. “The Sources of Life Chances: Does Education, Class Category, Occupation, or Short-Term Earnings Predict 20-Year Long-Term Earnings?.” Sociological Science5: 206–33.
41.
LaughlinL.SongX.WisniewskiM.XuJ.. 2024. “From Job Descriptions to Occupations: Using LLMs to Code and Rank Occupations.” in Presentation at the Annual Meeting of the Population Association.
42.
LeichtK. T.2020. “Occupations and Inequalities in the 21st Century: What’s in Your Wallet?.” Research in Social Stratification and Mobility70: 100550.
43.
LinK.-H.HungK.. 2022. “The Network Structure of Occupations: Fragmentation, Differentiation, and Contagion.” American Journal of Sociology127: 1551–601.
44.
MannetjeA.KromhoutH.2003. “The Use of Occupation and Industry Classifications in General Population Studies.” International Journal of Epidemiology32: 419–28.
45.
ManzoniA.VermuntJ. K.LuijkxR.MuffelsR.. 2010. “Memory Bias in Retrospectively Collected Employment Careers: A Model-Based Approach to Correct for Measurement Error.” Sociological Methodology40: 39–73.
46.
Martin-CaugheyA.2021. “What’s in an Occupation? Investigating Within-Occupation Variation and Gender Segregation Using Job Titles and Task Descriptions.” American Sociological Review86: 960–99.
47.
MassingN.WasmerM.WolfC.ZuellC.. 2019. “How Standardized is Occupational Coding? A Comparison of Results from Different Coding Agencies in Germany.” Journal of Official Statistics35: 167–87.
48.
MathiowetzN. A. 1992. “Errors in Reports of Occupation.” Public Opinion Quarterly56: 352–5.
49.
MellowW.SiderH.. 1983. “Accuracy of Response in Labor Market Surveys: Evidence and Implications.” Journal of Labor Economics1: 331–44.
50.
NakaoK.TreasJ.. 1994. “Updating Occupational Prestige and Socioeconomic Scores: How the New Measures Measure Up.” Sociological Methodology24: 1–72.
51.
PhelanJ. C.LinkB. G.TehranifarP.. 2010. “Social Conditions as Fundamental Causes of Health Inequalities: Theory, Evidence, and Policy Implications.” Journal of Health and Social Behavior51: S28–S40.
52.
PoterbaJ. M.SummersL. H.1995. “Unemployment Benefits and Labor Market Transitions: A Multinomial Logit Model with Errors in Classification.” Review of Economics & Statistics77: 207–16.
53.
SafikhaniP.AvetisyanH.Föste-EggersD.BroneskeD.. 2023. “Automated Occupation Coding with Hierarchical Features: A Data-Centric Approach to Classification with Pre-Trained Language Models.” Discover Artificial Intelligence3: 6.
54.
SakamotoA.WangS. X.2020. “The Declining Significance of Occupation in Research on Intergenerational Mobility.” Research in Social Stratification and Mobility70: 100521.
55.
SchierholzM.SchonlauM.. 2021. “Machine Learning for Occupation Coding—A Comparison Study.” Journal of Survey Statistics and Methodology9: 1013–34.
56.
ShahbazianR.BihagenE.. 2022. “Does Your Class Give More than a Hint of Your Lifetime Earnings?: Assessing Indicators for Lifetime Earnings Over the Life Course for Sweden.” European Sociological Review38: 527–42.
57.
SiegelP. M. (1971. “Prestige in the American Occupational Structure.” Ph.D. dissertation. Chicago, IL: University of Chicago.
58.
SongX.MasseyC. G.RolfK. A.FerrieJ. P.RothbaumJ. L.XieY.. 2020. “Long-Term Decline in Intergenerational Mobility in the United States since the 1850s.” Proceedings of the National Academy of Sciences of the United States of America117: 251–8.
59.
SongX.XieY.. 2023. “Occupational Percentile Rank: A New Method for Constructing a Socioeconomic Index of Occupational Status.” Sociological Methods & Research. doi:https://doi.org/10.1177/00491241231207914.
60.
TamboriniC. R.KimC. H.. 2013. “Are Proxy Interviews Associated with Biased Earnings Reports? Marital Status and Gender Effects of Proxy.” Social Science Research42: 499–512.
61.
ThompsonM.KornbauM. EVeselyJ.. 2012. “Creating an Automated Industry and Occupation Coding Process for the American Community Survey.” Census Working Papers.
62.
TillyC. 1999. Durable Inequality. Berkeley, CA: University of California Press.
63.
TippinsN. T.HiltonM. L. (eds.). 2010. A Database for a Changing Economy: Review of the Occupational Information Network (O*NET). Washington, D.C. National Academies Press.
64.
TorcheF.2015. “Analyses of Intergenerational Mobility: An Interdisciplinary Review.” ANNALS of the American Academy of Political and Social Science657: 37–62.
65.
WardleJ.WallerJ.JarvisM. J.2002. “Sex Differences in the Association of Socioeconomic Status with Obesity.” American Journal of Public Health92: 1299–304.
66.
WarrenJ. R.Halpern-MannersA.. 2012. “Panel Conditioning in Longitudinal Social Science Surveys.” Sociological Methods & Research41: 491–534.
67.
WeedenK. A.GruskyD. B.2005. “The Case for a New Class Map.” American Journal of Sociology111: 141–212.
68.
WrightE. O. (ed.). 2005. Approaches to Class Analysis. Cambridge, MA: Cambridge University Press.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
