Abstract

We examine whether racial discrimination exists in access to public services in the United States. We carry out an email correspondence study in which we pose simple queries to more than 19,000 local public service providers. We find that emails from putatively black senders are almost 4 percentage points less likely to receive an answer compared to emails signed with a white-sounding name. Moreover, responses to queries coming from black names are less likely to have a cordial tone. Further tests suggest that the differential in the likelihood of answering is due to animus toward blacks rather than inferring socioeconomic status from race. Finally, we show that attitudes toward the government among blacks are more negative in states with higher discrimination.

1. Introduction

African Americans have a disadvantaged position in American society in terms of economic outcomes, educational achievements, incarceration, health and life expectancy.1 Discrimination is commonly proposed as one of the possible causes of this predicament and has been documented in several realms, including the labor market, the judicial system, housing and product markets.2 In his review of racial inequality, Fryer (2011) underlines that “the new challenge is to understand the obstacles undermining the achievement of black and Hispanic children in primary and secondary school” (p. 857). Local public service providers like school districts and libraries have a major role to play in this regard; thus, discrimination in access to these services represents an important obstacle toward addressing racial inequality. More generally, public institutions at the local level—so-called street-level bureaucracies (Lipsky 1980)—are at the front-line of service delivery and thus play a key role in the policy-implementation process, exerting great influence on how policies are actually carried out and experienced by citizens. It is hence important to examine their attitudes and behavior vis-à-vis discrimination.

A central tenet of the U.S. law is the prohibition of racial discrimination by the government, with racial discrimination by public authorities prohibited and the principle of nondiscrimination central to governmental policy throughout the country (U.S. Government 2013). For instance, the Civil Rights Act of 1964 bans discrimination based on race by government agencies that receive federal funding. This is supplemented by several other provisions in federal and state law. For instance, under the Minnesota Human Rights Act (363A.12), “It is an unfair discriminatory practice to discriminate against any person in the access to, admission to, full utilization of or benefit from any public service because of race [...]”. Thus, discrimination by providers of public services not only has a potentially detrimental impact on the economic and social lives of those affected, but is also illegal. Furthermore, taste-based discrimination à la Becker (1957) is predicted to fade with intensified market competition and lower barriers to entry. Although deregulation and globalization may have increased competition in the U.S. economy, thus placing pressure on discriminatory attitudes in the private sector (see Levine, Rubinstein, and Levkov 2014, for relevant evidence from the financial industry), this has certainly been much less the case for the public sector.

In this study, we investigate racial discrimination across a wide range of public services. Targeted services include school districts, local libraries, sheriff offices, county clerks, county treasurers and job center veteran representatives. In particular, we collect all available emails of the targeted local public service providers, which gives us more than 19,000 cases, corresponding to roughly half of the total number of providers. Some of these services play important roles in relevant economic domains as they directly relate to employment (job centers) or education (school districts). Libraries also perform an important role by both promoting literacy and providing access to information and computer technology, thus facilitating activities like job-searching.3 The other services that we study involve typical government functions, like law enforcement (sheriffs), taxation (county treasurers), and general public administration (county clerks).4

To identify in a credible way whether there is racial discrimination in access to local public services, we conduct an email correspondence study. In particular, we solicit information relevant to access a public service (the office opening hours or some specific information, for example, the documentation needed for school enrollment) from 19,079 local public offices and observe whether or not we receive a reply depending on whether the request was signed with a distinctively white or black name. Correspondence and audit studies have been used to investigate discrimination in a variety of settings, including employment (Bertrand and Mullainathan 2004), housing (Ewens et al. 2014), product markets (Gneezy, List, and Price 2012; Doleac and Stein 2013), financial markets (Bayer, Ferreira, and Ross forthcoming), and along different dimensions, including race, ethnicity, gender, age, disability, sexual orientation, obesity, caste, and religion.5

Failing to provide information about a service is not equivalent to denying access to a service. However, there is growing evidence showing that the provision of information has an important impact on decisions and take-up rates. For instance, regarding the Earned Income Tax Credit, Bhargava and Manoli (2015) show that the mere receipt of a second notice just months after the receipt of an initial IRS notice led to substantial additional claiming. Hoxby and Turner (2013) show that providing information on the application process and colleges’ net costs has an effect on college enrollment. Hastings and Weinstein (2008) find that providing low-income families with direct information about school-level academic performances has an impact on parents’ school choice. Duflo and Saez (2003) show the effects of information on the decision to enroll in a tax deferred account retirement plan. Daponte, Sanders, and Taylor (1999) document that ignorance about the food stamp program contributes to nonparticipation. Thus, making it more difficult for a citizen to obtain information about a service is not merely a nuisance, but can also have an important impact on whether and how the citizen engages with the service. Moreover, experiencing even relatively small episodes of discrimination in a specific domain may erode the trust that an individual has in government institutions in general, potentially leading to the development of an “oppositional culture” with negative consequences, for instance, in terms of educational achievement (Fryer and Torelli 2010). Furthermore, the medical and psychological literature provides ample evidence of the negative effect of discrimination on physical and mental health (Harrell, Hall, and Taliaferro 2003), including so-called racial microaggressions, that is, subtle everyday experiences of racism (Wong et al. 2014). Finally, it seems implausible that a discriminatory attitude would only express itself in a very specific element of the service delivery, without having a more general impact. In other words, a librarian not replying to requests for information coming from blacks may also treat blacks differently in other aspects of the service, for example, by being less forthcoming when asked about a certain library resource. Thus, our measure of discrimination is informative about the general attitude permeating local public services.

Our results show that emails signed with a distinctively African-American name are less likely to receive a reply than identical emails signed with a distinctively white name, thus indicating the presence of discrimination in access to public services. In terms of magnitude, given a response rate of almost 72% for white senders, emails from putatively black senders are almost 4 percentage points less likely to receive an answer. This differential response is particularly strong among sheriff offices, but is also present in libraries and school districts. We also find that responses to inquiries coming from African-American names are less likely to have a cordial tone. Thus, despite a rising sentiment among whites that the so-called reverse discrimination is on the rise in the United States (Norton and Sommers 2011) due, for instance, to affirmative actions, what we find is evidence of discrimination against African Americans by public service providers. Note that email is an important channel of communication between the public and government agencies in the United States. A recent survey (Smith 2010) finds that contacting a government agency via email or a website is the second most preferred channel (28%)—telephone being the most preferred (35%)—and is a more preferred option than in-person visits (20%). Among internet users, online contact is the preferred option.

In the context of our study, the case for statistical discrimination is much weaker than in a labor market setting. Nevertheless, we also investigate whether the differential response rate is due to animus or to a form of statistical discrimination arising from assigning low socioeconomic status to a sender with a distinctively African-American name. In particular, we deploy two approaches, whereby the first entails predicting the race of the recipient and checking whether black recipients are more likely to respond to emails signed by black senders, as we would expect if taste-based discrimination by white recipients were at play. In the second approach, we attempt to directly fix the socioeconomic status of the sender—in a second wave of emails that we sent—by signaling his occupation. A change in the racial difference in responses across waves due to this additional information would indicate the importance of statistical discrimination. Both approaches are suggestive of taste-based discrimination being an important driver of the race gap in the response rate.

Our results are consistent with other studies that uncover evidence of racial/ethnic discrimination in public services, mostly involving various aspects of law enforcement. For instance, Alesina and La Ferrara (2014) find evidence consistent with the presence of racial prejudice in capital sentencing, driven exclusively by Southern states. Glaeser and Sacerdote (2003) look at vehicular homicides and find that drivers who kill blacks receive significantly shorter sentences. Abrams, Bertrand, and Mullainathan (2012) find support for the hypothesis that some judges treat defendants differently based upon their race. A recent study by political scientists regarding discrimination in the electoral process (White, Nathan, and Faller 2015) finds that emails about voting requirements sent to over 7,000 local U.S. election officials from Latino aliases are significantly less likely to receive a response and, if granted, to receive responses of lower quality than those sent from non-Latino white aliases. A related study by Butler and Broockman (2011)—albeit focusing on lawmakers rather than bureaucrats—involved sending emails asking for help with registering to vote to almost 5,000 U.S. state legislators. They find that putatively black requests receive fewer replies than requests coming from white aliases, even when the email signaled the sender’s partisan preference. Furthermore, Distelhorst and Hou (2014) find discriminatory behavior against ethnic Muslims by unelected public officials in China.

To the best of our knowledge, our study is the first to explore racial discrimination in a variety of local public services that perform important functions and constitute the majority of interactions between government institutions and citizens. The fact that we find evidence of discrimination has important implications for public policy, which we will discuss in the conclusions, after presenting the experimental set up in the next section and the results in Sections 3 and 4. In Section 5, we explore the association between our measure of discrimination and the racial gap in wages and attitudes toward government.

2. The Field Experiment

The field experiment—conducted in March/April 2015—entailed us sending email queries to over 19,000 local public offices, signing the emails with names that strongly evoke the race of the sender (white or black). In what follows, we describe the procedures surrounding the selection of public services, email queries, and names of sender, as well as the experimental design.

2.1. Type of Public Services, Emails and Names of Senders

The first step is to select which public services to target. We chose public services according to two criteria: (i) the provision of the service is at the county or subcounty level, to ensure a large number of observations and broad geographic coverage; and (ii) email addresses are publicly available or a directory of email addresses could be obtained. We came up with six types of public services that span a variety of local public services: school districts, local libraries, sheriff offices, county treasurers, job center veteran representatives, and county clerks. We were able to obtain over 21,000 email addresses and finally use 19,079 valid ones (the sources of email addresses are listed in Table A.1 in Appendix A).6,7 This constitutes our target population. Table 1 presents the breakdown of numbers and shares of emails by type of public service. The three most numerous public services are school districts, libraries and sheriff offices, which jointly account for almost 90% of the emails sent. The emails used in the field experiment account for nearly 50% of all existing potential recipients (Table B.1 in Appendix B reports the detailed number of existing recipients and of emails in the sample).

Table 1.

Emails by type of service.

RecipientNumberPercentage
School district9,87351.75
Library4,89425.65
Sheriff1,8369.62
Treasurer1,1295.92
Job center7313.83
County clerk6163.23
Total19,079100
RecipientNumberPercentage
School district9,87351.75
Library4,89425.65
Sheriff1,8369.62
Treasurer1,1295.92
Job center7313.83
County clerk6163.23
Total19,079100

Notes: Figures refer to the number of emails sent to each type of service.

Table 1.

Emails by type of service.

RecipientNumberPercentage
School district9,87351.75
Library4,89425.65
Sheriff1,8369.62
Treasurer1,1295.92
Job center7313.83
County clerk6163.23
Total19,079100
RecipientNumberPercentage
School district9,87351.75
Library4,89425.65
Sheriff1,8369.62
Treasurer1,1295.92
Job center7313.83
County clerk6163.23
Total19,079100

Notes: Figures refer to the number of emails sent to each type of service.

Figure 1 illustrates the geographic coverage and dispersion of our field experiment. It is evident that more populated counties and regions—which hence have a larger number of available recipients (such as the North-East)—receive a relatively large number of emails.

Location of recipients. White fill indicates counties with no recipients.
Figure 1.

Location of recipients. White fill indicates counties with no recipients.

Figure 2 plots the share of emails against the share of recipients across states. As can be seen, most observations are clustered around the 45-degree line, suggesting that the number of email addresses is proportional to the number of potential recipients across states. We will account for any discrepancies in one of our robustness checks.

Sample representativeness. Share of emails corresponds to the number of emails in a state over the total number of emails in the United States; share of potential recipients corresponds to the number of potential recipients in the state over all potential recipients in the entire United States.
Figure 2.

Sample representativeness. Share of emails corresponds to the number of emails in a state over the total number of emails in the United States; share of potential recipients corresponds to the number of potential recipients in the state over all potential recipients in the entire United States.

Our emails contain simple queries that were chosen not to impose significant effort/investment on the recipients’ part. Specifically, we use two types of email: simple and complex. Simple emails ask about the opening hours of the office, whereas complex emails ask for some additional yet basic information that an ordinary citizen might need to know to carry out a transaction with the office. For example, in the case of school districts, the simple email asks the following question: “I would like to enroll my son in a school in this district and I have some questions. Could you please tell me what your opening hours are?”. The complex email asks: “I would like to enroll my son in a school in this district. Could you please let me know the documents I would need to do this? Do I also need an immunization record?”. The idea of having both types of emails is to check whether the degree of discrimination changes with the complexity (i.e., amount of effort) required by the task. Every email has the following format:

**********************************

From: [Black/White Name]

Subject: [Opening Hours] or [Inquiry]

Hi,

My name is [Black/White Name] and I live in [City Name].

[Simple Query/Complex Query]

Thank you,

[Black/White Name]

**********************************

To make the name of the sender as noticeable and salient as possible, we show it three times: in the sender field, the main body and the signature. The complete set of questions are presented in Table A.2 in Appendix A.

Names of senders were chosen to evoke race as much as possible. We use two distinctively white names (Jake Mueller and Greg Walsh) and two distinctively African-American names (DeShawn Jackson and Tyrone Washington). Both the first names and surnames of our chosen names are among the most recognizable black and white names and have been previously used in correspondence studies (Bertrand and Mullainathan 2004; Butler and Broockman 2011; Broockman 2013; White et al. 2015).

We created four email addresses, with the local part comprising two letters and six numbers and the domain part being “gmail.com”, corresponding with the four chosen names. In each case, the display name of the email sender was the sender’s full name. The field “City Name” contains the name of the city where the public service provider is located.

2.2. Experimental Design

We sent the emails over a period of two weeks due to limits in the number of emails that can be sent daily. Emails are differentiated by the race of the person who signs it (white or black) and the type of query that it contains (simple or complex). This gives rise to a 2 × 2 research design with four treatments that correspond to the four possible pairs of race/email complexity. In most of the analysis, we pool the two black and two white names. We randomized the treatments at the state/public service type. This means, for example, that we randomized across school districts in California, and then across sheriff offices in California, and so forth. We also randomized the order in which emails were sent across the treatments, as well as across types of public services and states.

Table 2 shows summary statistics of various county characteristics of recipients broken down by whether the email that they received was signed by a distinctively white or black name. As can be seen, our sample is balanced across all of these characteristics (the data sources of these characteristics are presented in Table A.3 in Appendix A). As evident from Figure 1, the vast majority of counties (98.37%) are present in our sample with at least one recipient. Nevertheless, this is not the case for each type of recipient. Hence, in Table B.2 in Appendix B, we present summary statistics of the local characteristics of both counties that are covered in our sample and those that are not, by type of recipient.

Table 2.

County characteristics of Email recipients.

BlackWhitet-test (p-value)
% of blacks in employment6.10 (10.01)6.07 (10.25)0.83
Unemployment rate (%)6.13 (2.14)6.12 (2.11)0.82
% of Hispanic10.05 (13.91)9.83 (13.81)0.27
Average labor income (USD)794 (239)789 (237)0.17
Crime rate (%)2.45 (1.31)2.44 (1.29)0.47
% of Dem votes43.05 (15.13)42.96 (14.99)0.67
Urbanization71.80 (45)70.68 (45.53)0.09
N9,4729,607
BlackWhitet-test (p-value)
% of blacks in employment6.10 (10.01)6.07 (10.25)0.83
Unemployment rate (%)6.13 (2.14)6.12 (2.11)0.82
% of Hispanic10.05 (13.91)9.83 (13.81)0.27
Average labor income (USD)794 (239)789 (237)0.17
Crime rate (%)2.45 (1.31)2.44 (1.29)0.47
% of Dem votes43.05 (15.13)42.96 (14.99)0.67
Urbanization71.80 (45)70.68 (45.53)0.09
N9,4729,607

Notes: Standard deviations in parentheses. p-value refers to the t-test for the difference between two means.

Table 2.

County characteristics of Email recipients.

BlackWhitet-test (p-value)
% of blacks in employment6.10 (10.01)6.07 (10.25)0.83
Unemployment rate (%)6.13 (2.14)6.12 (2.11)0.82
% of Hispanic10.05 (13.91)9.83 (13.81)0.27
Average labor income (USD)794 (239)789 (237)0.17
Crime rate (%)2.45 (1.31)2.44 (1.29)0.47
% of Dem votes43.05 (15.13)42.96 (14.99)0.67
Urbanization71.80 (45)70.68 (45.53)0.09
N9,4729,607
BlackWhitet-test (p-value)
% of blacks in employment6.10 (10.01)6.07 (10.25)0.83
Unemployment rate (%)6.13 (2.14)6.12 (2.11)0.82
% of Hispanic10.05 (13.91)9.83 (13.81)0.27
Average labor income (USD)794 (239)789 (237)0.17
Crime rate (%)2.45 (1.31)2.44 (1.29)0.47
% of Dem votes43.05 (15.13)42.96 (14.99)0.67
Urbanization71.80 (45)70.68 (45.53)0.09
N9,4729,607

Notes: Standard deviations in parentheses. p-value refers to the t-test for the difference between two means.

Six weeks after the first set of emails were sent to all recipients, we sent a second wave of emails. The structure of the email was the same as in the first wave, aside from modifying the signature as illustrated in what follows:

**********************************

[Black/White Name]

Real Estate Agent

Buy - Sell - Rent

**********************************

The purpose of this is to fix the emails recipients’ perceptions about the socioeconomic background of the sender. In the second wave, we randomized the race of the sender and changed the email type, whereby those recipients who received a simple email in the first wave were sent a complex one in the second wave and vice versa. To avoid any suspicion that may arise from receiving two emails from the same person, we used a different name within the same race for those cases—about half of the sample—where a recipient was randomized to receive an email signed by the same race in both waves.

Our main outcome is whether the email is answered. Furthermore, we also investigate measures of the quality of response by focusing on the number of responses received, the length of the response (number of words), the delay in the response and how cordial the response is.

3. Results

3.1. Descriptive Statistics

Overall, about 70% of the 19,079 emails that we sent received a response (see Table B.3 for detailed statistics). This indicates that public service providers are generally quite responsive to queries coming from the public, despite a non-negligible share of them going unanswered. The response rate was 68.88% for simple emails and 70.84% for complex emails, which is surprising given that complex emails seemingly require more effort from the recipient. A possible explanation could be that responders may consider the information solicited by simple emails (i.e., opening times) to be easily available from various sources and thus they feel less compelled to provide an answer to such a query.

Emails signed by white-sounding names (we will refer to them as “white emails” hereafter) receive a response in 71.66% of the cases, whereas those signed by black-sounding names (henceforth: “black emails”) in only 67.96% of the cases, with the difference of 3.7 percentage points being strongly statistically significant (z-stat, p-value < 0.000). The response rate to emails coming from the two white-sounding names is almost identical (71.74% for Jake Mueller and 71.57% for Greg Walsh; z-stat, p-value 0.85), whereas there is a difference between the two black-sounding names (69.05% for DeShawn Jackson and 66.91% for Tyrone Washington; z-stat, p-value 0.03). Given that both first names are among the most recognizable African-American names according to Fryer and Levitt (2004), it is possible that this difference emerges because one of the last names has a stronger association with black people than the other.8 Indeed, the 2000 Census shows that among the persons who are called Jackson, 53.02% are black and 41.93% are white, whereas for Washington the figures are 89.87% and 5.16%, respectively. In both cases, the response rate is significantly lower than that for white emails. Hence, hereafter we will consider the difference between white and black emails without distinguishing between the two names within each category.

To summarize, the descriptive evidence indicates considerable racial differences in the response rate to the emails.

3.2. Main Results

Next, we examine whether there are racial differences in response rates in a regression framework, which allows us to control for various factors such as the type of public service, state fixed effects and several county characteristics. Specifically, we estimate linear probability regressions of the form
(1)
where Response is a binary variable indicating whether a response to the email was provided. This variable is coded as 1 if the response was received within 40 days and 0 otherwise. The variable |$ {\mathit {Service\,Type}}$| indicates the type of public service to which the email was sent, |$ {\mathit {Complex\,Email}}$| is a binary variable indicating whether the email was simple or complex, |$ {\mathit {Black}}$| is a binary variable indicating whether the email was signed by a distinctively black name, X is a vector of county level characteristics that we use as controls, s represents state fixed effects and d are indicators for the calendar days when emails were sent out. Standard errors are clustered at the state/public service type level. Estimating regressions with state/public service fixed effects produces numerically similar results across all our specifications. The main coefficient of interest in these regressions is δ, which tells us whether there is a differential response according to the racial identity of the sender.

Table 3 summarizes the main regression results. Column (1) includes state, public service type and sending day fixed effects. The estimated racial gap in response rates—at 3.84 percentage points—does not substantially differ from that emerging from the raw comparison reported in the previous section (3.7 percentage points). Column (2) adds a dummy variable that takes the value of one if the email question is complex. In line with the raw comparison, complex emails are more likely (1.84 percentage points) to receive a response than simple emails. In column (3), we examine whether the differential response rate between white and black emails varies according to complexity by adding an interaction term between the black name and the complex email dummies. The estimate of the interaction term proves to be small and statistically insignificant, indicating that the differential in the response rate is not specific to the nature of the query. In column (4), which represents our baseline specification, we include various county level characteristics (unemployment rate, average wage, share of Hispanic population, crime rate, share of democratic votes, rural/urban dummy). Unsurprisingly, since the emails are randomly assigned, we find that the inclusion of these controls does not change the racial difference in response rate estimated in column (1). Finally, in column (5) we exploit the second wave of emails and particularly the fact that half of the recipients receive emails from senders with different races across the two waves. We hence estimate a model with office (recipient) fixed effects. The within-recipient variation in the responsiveness to white and black emails is similar to that estimated in column (1) (3.22 percentage points).

Table 3.

Difference in response rates.

12345
Black−0.038*** (0.006)−0.038*** (0.006)−0.037*** (0.009)−0.038*** (0.006)−0.032*** (0.005)
Complex0.018*** (0.007)0.019** (0.009)0.018*** (0.007)0.029*** (0.004)
Black × Complex−0.002 (0.013)
|$\bar {Y}$|0.6980.6980.6980.6980.665
R20.0450.0450.0450.0490.023
N19,07919,07919,07919,07938,168
State/service/date F.E.YYYYY
County controlsNNNYN
Office F.E.NNNNY
12345
Black−0.038*** (0.006)−0.038*** (0.006)−0.037*** (0.009)−0.038*** (0.006)−0.032*** (0.005)
Complex0.018*** (0.007)0.019** (0.009)0.018*** (0.007)0.029*** (0.004)
Black × Complex−0.002 (0.013)
|$\bar {Y}$|0.6980.6980.6980.6980.665
R20.0450.0450.0450.0490.023
N19,07919,07919,07919,07938,168
State/service/date F.E.YYYYY
County controlsNNNYN
Office F.E.NNNNY

Notes: Robust standard errors in parentheses clustered at the state/public service type level. **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). County controls are: unemployment rate, average wage, share of Hispanic in the population, crime rate, share of votes to democrats in presidential elections, and a dummy for rural/urban counties. Office fixed-effects refer to a regression that uses data from the two waves. In the model in column (5), R2 represents the within R2.

Table 3.

Difference in response rates.

12345
Black−0.038*** (0.006)−0.038*** (0.006)−0.037*** (0.009)−0.038*** (0.006)−0.032*** (0.005)
Complex0.018*** (0.007)0.019** (0.009)0.018*** (0.007)0.029*** (0.004)
Black × Complex−0.002 (0.013)
|$\bar {Y}$|0.6980.6980.6980.6980.665
R20.0450.0450.0450.0490.023
N19,07919,07919,07919,07938,168
State/service/date F.E.YYYYY
County controlsNNNYN
Office F.E.NNNNY
12345
Black−0.038*** (0.006)−0.038*** (0.006)−0.037*** (0.009)−0.038*** (0.006)−0.032*** (0.005)
Complex0.018*** (0.007)0.019** (0.009)0.018*** (0.007)0.029*** (0.004)
Black × Complex−0.002 (0.013)
|$\bar {Y}$|0.6980.6980.6980.6980.665
R20.0450.0450.0450.0490.023
N19,07919,07919,07919,07938,168
State/service/date F.E.YYYYY
County controlsNNNYN
Office F.E.NNNNY

Notes: Robust standard errors in parentheses clustered at the state/public service type level. **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). County controls are: unemployment rate, average wage, share of Hispanic in the population, crime rate, share of votes to democrats in presidential elections, and a dummy for rural/urban counties. Office fixed-effects refer to a regression that uses data from the two waves. In the model in column (5), R2 represents the within R2.

As mentioned in the experimental design Section, the share of emails for each state does not perfectly match the share of potential recipients in each state. Despite generally not being very large, this discrepancy makes some states under-represented and others over-represented. To correct for this, in unreported regressions, we have reestimated the model in column (4) of Table 3 by weighting observations by the ratio of the number of recipients in each state to the number of emails sent in the state. The estimate (−0.036, s.e. 0.007) is remarkably close to that of the baseline specification. Next, we checked the sensitivity of our results to the clustering of the standard errors. Clustering at a level other than state/public service type does not affect the precision of our estimates. In particular, if we were to cluster at the state/public service type/sender name level, the standard error of the black dummy coefficient in the baseline model would be 0.008, whereas if we were to cluster at the county/public service type level, the standard error would be 0.007.9

3.3. Type of Public Service

It is important to recall that our sample comprises six different public services with different sizes in the sample due to a combination of differences in how many of them are present in the country and in email availability. One might be interested in knowing whether our results might be driven by one particular type of public service. Hence, we analyze the results by type of service. When considering the response rates, the pattern of higher response rates for white emails holds in all cases, except for job centers. The raw differences in response rates are presented in Table B.4 in Appendix B.

In Table 4, we estimate the econometric model in equation (1) for each type of public service. The results essentially confirm the patterns of the descriptive statistics, with estimates only being statistically significant for school districts, libraries and sheriff offices and the largest racial difference found in the latter group. This is in line with the literature mentioned in the Introduction finding evidence of discrimination in law enforcement. The finding of a lack of discrimination for more administrative-type jobs, like county clerks or job centers, goes against what found for the U.S. election officials (White et al. 2015), but the roles are of course very different.10

Table 4.

Type of public service.

School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.035*** (0.009)−0.041*** (0.010)−0.074*** (0.021)−0.040 (0.029)0.008 (0.031)−0.016 (0.048)
|$\bar {Y}$|0.7480.6700.4980.7180.7250.649
R20.0400.0470.1080.0820.1640.092
N9,8734,8941,8361,129731616
School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.035*** (0.009)−0.041*** (0.010)−0.074*** (0.021)−0.040 (0.029)0.008 (0.031)−0.016 (0.048)
|$\bar {Y}$|0.7480.6700.4980.7180.7250.649
R20.0400.0470.1080.0820.1640.092
N9,8734,8941,8361,129731616

Notes: Robust standard errors in parentheses clustered at the state level. ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. All regressions include controls of column (4), Table 3.

Table 4.

Type of public service.

School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.035*** (0.009)−0.041*** (0.010)−0.074*** (0.021)−0.040 (0.029)0.008 (0.031)−0.016 (0.048)
|$\bar {Y}$|0.7480.6700.4980.7180.7250.649
R20.0400.0470.1080.0820.1640.092
N9,8734,8941,8361,129731616
School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.035*** (0.009)−0.041*** (0.010)−0.074*** (0.021)−0.040 (0.029)0.008 (0.031)−0.016 (0.048)
|$\bar {Y}$|0.7480.6700.4980.7180.7250.649
R20.0400.0470.1080.0820.1640.092
N9,8734,8941,8361,129731616

Notes: Robust standard errors in parentheses clustered at the state level. ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. All regressions include controls of column (4), Table 3.

3.4. Geographic Heterogeneity

Racial disparities might not be equally distributed across the United States. For example, recent evidence from Stephens-Davidowitz (2014) shows that Google search queries with racially charged language are particularly intense in Southern states. We therefore explore whether there is geographic heterogeneity in the racial difference in the response rate. For this purpose, we split our sample into the four regions defined by the Census Bureau (North-East, Mid-West, South, and West) and estimate our baseline specification on each subsample.11 Table 5 summarizes the results. We find a significant racial gap in all four regions, with the estimate ranging from −0.026 in the North-East to −0.049 in the Mid-West.12

Table 5.

Heterogeneity by geographical areas.

RegionsCounties
North-EastMid-WestSouthWestRuralUrban
Black−0.026** (0.010)−0.049*** (0.010)−0.031** (0.013)−0.039** (0.017)−0.058*** (0.011)−0.030*** (0.007)
|$\bar {Y}$|0.7280.7220.6350.7080.6600.714
R20.0360.0490.0750.0360.0870.038
N3,6667,3464,9753,0925,48813,591
RegionsCounties
North-EastMid-WestSouthWestRuralUrban
Black−0.026** (0.010)−0.049*** (0.010)−0.031** (0.013)−0.039** (0.017)−0.058*** (0.011)−0.030*** (0.007)
|$\bar {Y}$|0.7280.7220.6350.7080.6600.714
R20.0360.0490.0750.0360.0870.038
N3,6667,3464,9753,0925,48813,591

Notes: Robust standard errors in parentheses clustered at the state/public service type level. **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. All regressions include controls of column (4), Table 3.

Table 5.

Heterogeneity by geographical areas.

RegionsCounties
North-EastMid-WestSouthWestRuralUrban
Black−0.026** (0.010)−0.049*** (0.010)−0.031** (0.013)−0.039** (0.017)−0.058*** (0.011)−0.030*** (0.007)
|$\bar {Y}$|0.7280.7220.6350.7080.6600.714
R20.0360.0490.0750.0360.0870.038
N3,6667,3464,9753,0925,48813,591
RegionsCounties
North-EastMid-WestSouthWestRuralUrban
Black−0.026** (0.010)−0.049*** (0.010)−0.031** (0.013)−0.039** (0.017)−0.058*** (0.011)−0.030*** (0.007)
|$\bar {Y}$|0.7280.7220.6350.7080.6600.714
R20.0360.0490.0750.0360.0870.038
N3,6667,3464,9753,0925,48813,591

Notes: Robust standard errors in parentheses clustered at the state/public service type level. **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. All regressions include controls of column (4), Table 3.

To further document this pattern of geographical variation, in columns (5) and (6), we classify counties into urban and rural and split the sample along this dimension.13 This gives rise to 1,312 rural counties and 1,780 urban counties. The results indicate that the racial gap in response rate is substantially larger in rural areas, namely almost double than urban areas. This is consistent with the fact that we find a larger racial gap in the Mid-West, where the incidence of rural counties is highest.

Evidence that the differential treatment in response vis-à-vis African Americans is not worse in Southern states might appear as striking given the relatively higher density of black population. However, an important consideration is that the percentage of blacks employed in public services is also higher in such regions. As we will document in Section 4, the race of the recipient plays an important role in determining the magnitude of the racial disparity.

3.5. Additional Results: Other Outcomes

The outcome analyzed so far is whether an inquiry receives a reply. In this section we investigate whether there are differences in the quality of the reply, as measured by the number of replies sent by the receiver and the length of the email (number of words). We also use a measure of cordiality of the response: a binary variable concerning whether the respondent addresses the sender by name or with a salutation.14 Finally, we consider the intensive margin of replies, measuring the number of hours it takes for the recipient to reply.

Table B.5 in Appendix B shows descriptive statistics related to these outcomes. Most respondents sent just one reply, although a few also send some follow-up emails. The average length of emails is just above 171 words, and it takes on average just over a day (25 h) to receive a reply. For these three outcomes, a raw comparison suggests no difference between black and white senders. There appears to be a difference in the measure of cordiality, with 73.52% of responses to white emails being classified as cordial as opposed to 67.9% of responses to black emails. This is confirmed by the regression analysis in Table 6, whereby cordiality represents the only significant difference between black and whites. Furthermore, Table C.1 in Appendix C shows that this difference is statistically significant in 5 out of the 6 types of public services (all but the job centers). Therefore, it appears that black emails are not only less likely to receive a response but also that—conditional on receiving a response—it is less likely to have a cordial tone.15

Table 6.

Other outcomes.

NumberLengthCordialDelay
Black−0.001 (0.003)−0.114 (1.847)−0.062*** (0.007)−0.918 (1.147)
|$\bar {Y}$|1.029171.0410.70824.684
R20.0150.0550.1140.031
N13,32113,32113,32113,321
NumberLengthCordialDelay
Black−0.001 (0.003)−0.114 (1.847)−0.062*** (0.007)−0.918 (1.147)
|$\bar {Y}$|1.029171.0410.70824.684
R20.0150.0550.1140.031
N13,32113,32113,32113,321

Notes: Robust standard errors in parentheses clustered at the state/public service type level. ***p < 0.01. Dependent variables are, respectively: number of replies obtained, length of replies (number of words), whether the sender was addressed by name or with salutations, and delay in obtaining a reply (number of hours). |$\bar {Y}$| refers to the average of the outcome variable reported in each column header. All regressions include controls of column (4), Table 3.

Table 6.

Other outcomes.

NumberLengthCordialDelay
Black−0.001 (0.003)−0.114 (1.847)−0.062*** (0.007)−0.918 (1.147)
|$\bar {Y}$|1.029171.0410.70824.684
R20.0150.0550.1140.031
N13,32113,32113,32113,321
NumberLengthCordialDelay
Black−0.001 (0.003)−0.114 (1.847)−0.062*** (0.007)−0.918 (1.147)
|$\bar {Y}$|1.029171.0410.70824.684
R20.0150.0550.1140.031
N13,32113,32113,32113,321

Notes: Robust standard errors in parentheses clustered at the state/public service type level. ***p < 0.01. Dependent variables are, respectively: number of replies obtained, length of replies (number of words), whether the sender was addressed by name or with salutations, and delay in obtaining a reply (number of hours). |$\bar {Y}$| refers to the average of the outcome variable reported in each column header. All regressions include controls of column (4), Table 3.

This result seems consistent with evidence of prejudice rather than statistical discrimination. Even if, for instance, dealing with citizens of low socioeconomic background is more costly in terms of time or effort and recipients use race to infer the socioeconomic background of the sender, once a response is sent it seems unjustified to use a less cordial tone toward African-American senders. We explore the interpretation of our overall results in depth in the next section.

4. Interpretation

Thus far, our results indicate a statistically and economically significant difference in the response to emails signed by white and African-American names. One possible interpretation is that this represents taste or prejudice-based discrimination, whereby responders may have an aversion to interacting with citizens with black-sounding names due to racially prejudicial attitudes or they may consider such citizens less worthy of their effort and attention. Another possibility is that the lower response to black emails represents a form of statistical discrimination, whereby the distinctively African-American names might signal some other personal trait, besides race, such as a certain socioeconomic background (Fryer and Levitt 2004). In the labor market context, it has been argued that employers may use race to infer unobserved characteristics that are relevant for productivity. Thus, profit maximizing employers may statistically discriminate against some groups even if they are unprejudiced. In our setting, characterized by a one-shot interaction between the sender and a public officer, the case for statistical discrimination is weaker and less likely to be of first order importance. Nevertheless, it is conceivable to think that public officers may attempt to minimize effort and perceive senders with a lower socioeconomic status (SES) as requiring more help. In absence of direct information about SES, public officers may use race to infer it and, thus, be less likely to respond to queries coming from black-sounding names. Alternatively, officers may try to minimize the likelihood of being reprimanded, may consider senders with a low SES as less assertive and, thus, infer that senders with a black-sounding name are less likely to complain if their query is left unanswered. In what follows, we explore the relevance of taste-based vis-à-vis statistical discrimination adopting two approaches: the first uses the inferred race of the respondent and the second uses the socioeconomic background signaled by the occupation of the sender. Moreover, we also explore the correlation of a discrimination index constructed using our data to measures of racial prejudice used in the literature.

4.1. Race of the Recipient

In the first approach, we consider that if statistical discrimination were the primary driver of the difference, we would expect the recipient’s race not to be an important predictor of a response to a black email. Accordingly, white and black recipients should have a similar propensity to respond to names conveying low socioeconomic background, that is, African-American names.

As a first attempt at assessing this view, consider Figure 3, which plots a discrimination index from our data against the share of black population in employment, both at the state level. The discrimination index is obtained by aggregating responses at the state level and then calculating the racial gap in response rates (with larger values indicating higher discrimination). To increase the precision of our measure, we pooled data from both the first and second wave. The relationship between these two variables—weighted by the number of emails sent in each state—appears to be negative.16

Difference in response rates and % of blacks in employment. The discrimination index is obtained by pooling the data of the two waves and aggregating the data at the state level. Observations are weighted by the number of emails sent in each state. N = 50 (Washington D.C. is excluded).
Figure 3.

Difference in response rates and % of blacks in employment. The discrimination index is obtained by pooling the data of the two waves and aggregating the data at the state level. Observations are weighted by the number of emails sent in each state. N = 50 (Washington D.C. is excluded).

Since we do not have exact information about the race of the recipient, we try to proxy for it by using two methodologies. In the first approach, for which we report the results in Table 7, we proxy for the probability of the person who receives the email being black using four measures: the share of blacks among employed individuals in the county (columns (1) and (2)); the share of blacks among employed individuals in the public sector in the county (columns (3) and (4)); the share of blacks working as education administrators, sheriffs and librarians in the county (columns (5) and (6)); the share of blacks among school principals in the state (columns (7) and (8)).17

Table 7.

Mechanisms: Race of recipient.

% of blacks
In employmentIn public sectorAmong educators, librarians and sheriffsAmong school principals
Black−0.038*** (0.006)−0.051*** (0.008)−0.019** (0.009)−0.048*** (0.013)−0.023** (0.010)−0.051*** (0.013)−0.032*** (0.009)−0.073*** (0.015)
% of blacks−0.243*** (0.072)−0.344*** (0.078)−0.181 (0.115)−0.323*** (0.124)−0.165 (0.132)−0.316** (0.140)−0.090 (0.158)−0.265* (0.132)
Black × % of blacks0.208*** (0.070)0.272*** (0.090)0.288*** (0.101)0.366*** (0.122)
|$\bar {Y}$|0.6980.6980.7250.7250.7240.7240.7440.744
R20.0500.0510.0280.0290.0280.0290.0090.010
N19,07919,0797,4067,4066,0476,0476,7936,793
% of blacks
In employmentIn public sectorAmong educators, librarians and sheriffsAmong school principals
Black−0.038*** (0.006)−0.051*** (0.008)−0.019** (0.009)−0.048*** (0.013)−0.023** (0.010)−0.051*** (0.013)−0.032*** (0.009)−0.073*** (0.015)
% of blacks−0.243*** (0.072)−0.344*** (0.078)−0.181 (0.115)−0.323*** (0.124)−0.165 (0.132)−0.316** (0.140)−0.090 (0.158)−0.265* (0.132)
Black × % of blacks0.208*** (0.070)0.272*** (0.090)0.288*** (0.101)0.366*** (0.122)
|$\bar {Y}$|0.6980.6980.7250.7250.7240.7240.7440.744
R20.0500.0510.0280.0290.0280.0290.0090.010
N19,07919,0797,4067,4066,0476,0476,7936,793

Notes: Robust standard errors in parentheses clustered at the state/public service type level. *p < 0.10; **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. % of blacks in employment refers to the county share of blacks among the employed population. Data have been obtained from the 2006–2010 American Community Survey (ACS). % of blacks in employment refers to the county share of blacks among the population employed in the public sector. Data have been obtained from the 2006–2010 American Community Survey (ACS) and are available for 573 counties. % of blacks among educators, librarians and sheriffs refers to the county share of blacks working in the following occupations: Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers. Data have obtained from Census 2000 and ACS 2001–2015 and are available for 469 counties. % of blacks among school principals refers to the state share of blacks working as school principals. Data have obtained from the 2011–2012 Schools and Staffing Survey and are available for 28 states. All regressions include controls of column (4), Table 3.

Table 7.

Mechanisms: Race of recipient.

% of blacks
In employmentIn public sectorAmong educators, librarians and sheriffsAmong school principals
Black−0.038*** (0.006)−0.051*** (0.008)−0.019** (0.009)−0.048*** (0.013)−0.023** (0.010)−0.051*** (0.013)−0.032*** (0.009)−0.073*** (0.015)
% of blacks−0.243*** (0.072)−0.344*** (0.078)−0.181 (0.115)−0.323*** (0.124)−0.165 (0.132)−0.316** (0.140)−0.090 (0.158)−0.265* (0.132)
Black × % of blacks0.208*** (0.070)0.272*** (0.090)0.288*** (0.101)0.366*** (0.122)
|$\bar {Y}$|0.6980.6980.7250.7250.7240.7240.7440.744
R20.0500.0510.0280.0290.0280.0290.0090.010
N19,07919,0797,4067,4066,0476,0476,7936,793
% of blacks
In employmentIn public sectorAmong educators, librarians and sheriffsAmong school principals
Black−0.038*** (0.006)−0.051*** (0.008)−0.019** (0.009)−0.048*** (0.013)−0.023** (0.010)−0.051*** (0.013)−0.032*** (0.009)−0.073*** (0.015)
% of blacks−0.243*** (0.072)−0.344*** (0.078)−0.181 (0.115)−0.323*** (0.124)−0.165 (0.132)−0.316** (0.140)−0.090 (0.158)−0.265* (0.132)
Black × % of blacks0.208*** (0.070)0.272*** (0.090)0.288*** (0.101)0.366*** (0.122)
|$\bar {Y}$|0.6980.6980.7250.7250.7240.7240.7440.744
R20.0500.0510.0280.0290.0280.0290.0090.010
N19,07919,0797,4067,4066,0476,0476,7936,793

Notes: Robust standard errors in parentheses clustered at the state/public service type level. *p < 0.10; **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model). |$\bar {Y}$| refers to the average response rate. % of blacks in employment refers to the county share of blacks among the employed population. Data have been obtained from the 2006–2010 American Community Survey (ACS). % of blacks in employment refers to the county share of blacks among the population employed in the public sector. Data have been obtained from the 2006–2010 American Community Survey (ACS) and are available for 573 counties. % of blacks among educators, librarians and sheriffs refers to the county share of blacks working in the following occupations: Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers. Data have obtained from Census 2000 and ACS 2001–2015 and are available for 469 counties. % of blacks among school principals refers to the state share of blacks working as school principals. Data have obtained from the 2011–2012 Schools and Staffing Survey and are available for 28 states. All regressions include controls of column (4), Table 3.

We observe that the share of blacks in the local area (columns (1), (3), (5), and (7)) is associated with a significant reduction in the probability of receiving a response.18 When we interact the share of blacks with the black dummy variable (columns (2), (4), (6), and (8)), we obtain a positive and statistically significant coefficient, indicating that the higher the probability of the recipient being African American, the higher the probability that a black email receives a response. This result is consistent across the various measures considered. In additional tests, we estimated models interacting the quartiles of the share of blacks with the black dummy variable, finding similar results.19

To facilitate an interpretation of these estimates, Figure 4 shows the predicted probability of response using the estimates in column (2) of Table 7 by deciles of the distribution of the share of blacks in employment. Predictions are calculated by varying the values of the share of blacks in employment (represented by the midpoint of each decile) and averaging over the remaining covariates. The figure shows that there is a statistically significant difference in the predicted probability of response across races where the likelihood of the recipient to be black is less than 10% (bottom eight deciles). In the top two deciles, where the probability that a recipient is black becomes more substantial, the predicted response rates for the two races become indistinguishable.

Race of recipient. Predictions from column (2) of Table 7. The x-axis represents deciles of the share of blacks in employment. The estimates are calculated at the values of the 5%, 15%, ..., 95% percentiles. These values are: 0, 0.002, 0.004, 0.008, 0.013, 0.023, 0.042, 0.072, 0.123, 0.272.
Figure 4.

Race of recipient. Predictions from column (2) of Table 7. The x-axis represents deciles of the share of blacks in employment. The estimates are calculated at the values of the 5%, 15%, ..., 95% percentiles. These values are: 0, 0.002, 0.004, 0.008, 0.013, 0.023, 0.042, 0.072, 0.123, 0.272.

The evidence presented thus far suggests that African-American recipients are less likely to ignore black emails, supporting the interpretation that the estimated gap reflects taste-based discrimination. In the second approach, we attempt to identify the race of the recipient more directly by inferring it from the surname associated with each email address. Given that each email address in our data (except for Job Centers) is provided with a contact person, we have name and surname information for both respondents and nonrespondents. For each surname, we compute two indices for the “probable race” of recipient, one for black names and one for white names, corresponding to the frequencies of surnames by race and ethnicity as reported in the 2000 Census.20 The idea is to proxy for the probability that a certain name is white or black. We can then order surnames in our database according to the confidence by which we can associate them with a certain race, thereby obtaining a distribution for the “probable race” index. Subsequently, we set several thresholds corresponding to fixed percentiles of this distribution. For example, a threshold of 1% means that we select the top 1% values of the distribution. In the case of African Americans, this threshold includes values of the probable race index that range from 48.38% (e.g., the surname Mack, with the census showing that nearly half of the people holding this surname are black) to 94.39% (e.g., the surname Ravenell, for which blacks represent the great majority). In the case of whites, the 1% threshold includes values ranging from 99% (e.g., the surname Kobylski) to 99.82% (e.g., the surname Sickle). Lower thresholds include surnames that are less characteristic, for example, for blacks Nicholson (with a value of 18.74%) and for whites Kline (with a value of 95.38%). We can subsequently select samples of recipients for which we are increasingly confident about their association with a specific race and estimate the corresponding racial gap in response. We present these estimates in Figure 5, which shows that: (i) samples where the name of the recipient is identified as being black are associated with a smaller race gap in response than those identified as being white, and (ii) the more accurately (e.g., a threshold of 5% or 1%) we can designate the race of the recipient as being black (white), the smaller (larger) the estimated adverse treatment experienced by blacks, although estimates become more imprecise. Again, these results are consistent with the taste-based discrimination interpretation of the differential response rate that we find.

Discrimination conditional on probable race of recipient. Points represent regression coefficients estimated on subsamples of data. Subsamples are defined first by constructing an index of the probability of belonging to the white or black race (matching surname from our data to the 2000 Census). Thresholds indicate the upper portion of the frequency distribution of the index and are used to define the various subsamples.
Figure 5.

Discrimination conditional on probable race of recipient. Points represent regression coefficients estimated on subsamples of data. Subsamples are defined first by constructing an index of the probability of belonging to the white or black race (matching surname from our data to the 2000 Census). Thresholds indicate the upper portion of the frequency distribution of the index and are used to define the various subsamples.

We also explore whether there exists a negative association between racial segregation and discrimination, as the contact hypothesis (Allport 1954) would suggest. We estimate models similar to Table 7 using indices for residential and school segregation instead of share of blacks. In the case of residential segregation, we found a negative, statistically significant coefficient for the interaction term (−0.018, s.e. 0.006). In the case of school segregation, we found a positive but weaker and statistically insignificant coefficient for the interaction term (0.015, s.e. 0.014). We report these results in Table C.2 of Appendix C.

4.2. Fixing the Socioeconomic Background

We next turn attention to the second wave of emails that, as mentioned in the description of the experiment, includes a signature indicating the sender’s occupation (real estate agent). Note that, according to data from the Bureau of Labor Statistics for 2014, the annual mean wage of real estate agents ($55,530) is above the annual mean wage for all occupations ($47,230).21 The literature generally finds no significant income differences by race.22 Hence, this occupation should act as a signal to the recipient that the sender is a middle-class person or at least that he does not belong to a particularly low socioeconomic group. The idea behind this test is that, similar to Oreopoulos (2011), if providing additional information regarding the sender changes the racial gap in terms of responsiveness by public officials, then this would be an indication of statistical discrimination playing a role. We may have an increase or a decrease in the gap, depending on how black and white real estate agents compare to generic citizens with black and white sounding names in terms of—for instance—the perceived effort that a public officer expects to exert when dealing with a query from them. Also, the overall response rate may increase or decrease. The critical aspect behind this test is that information about socioeconomic background may affect only statistical discrimination, as this depends on information other than race, whereas animus should depend only on information about race. However, it is possible that providing information about socioeconomic status shifts the expected cost of dealing with blacks and whites in a parallel way or that the signal of socioeconomic status is uninformative or goes completely unnoticed, thus leaving the gap unchanged even if statistical discrimination plays a role. Thus, although finding a change in the gap would be an indication of the importance of statistical discrimination, not detecting a change is not necessarily an indication of a lack of importance. In Appendix  D, we provide a simple analytical framework to illustrate these points.

Looking at the results, the overall response rate to the second wave’s emails is slightly lower than the first wave (63.24%). In column (1) of Table 8, we report the racial difference in response rate estimated from our baseline linear probability regression using only data from the second wave. We find the racial gap to be 3.68 percentage points, almost identical to what we estimated in the first wave where there was no occupation signal. Under the assumption that recipients notice the profession indicated in the signature, this provides evidence that the differential response to white versus African-American names is not specific to black names that are associated with low socioeconomic background, but is also present when we compare emails sent by individuals who belong to a middle income occupational group. In column (2), we pool observations of the two waves, finding remarkably similar results. In column (3), we test whether there is a difference in the treatment between black and white emails across the two waves, finding that the interaction term between the black dummy and the dummy for the second wave is very small and not statistically significant.23 In columns (4)–(6), we estimate the same regressions using cordial reply as the outcome variable. The estimates are remarkably similar to those obtained in Table 6, indicating that the differential in the likelihood of receiving a reply with a cordial tone is not attributable to black names that might evoke low socioeconomic background.

Table 8.

Fixed socioeconomic background.

ReplyCordial reply
Wave IIPooled wavesWave IIPooled waves
Black−0.037*** (0.007)−0.038*** (0.005)−0.039*** (0.006)−0.061*** (0.008)−0.061*** (0.006)−0.062*** (0.007)
Black × Wave II0.002 (0.008)0.002 (0.011)
|$\bar {Y}$|0.6320.6650.6650.7020.7050.705
R20.0510.0520.0520.1050.1070.107
N19,08938,16838,16812,07225,39325,393
ReplyCordial reply
Wave IIPooled wavesWave IIPooled waves
Black−0.037*** (0.007)−0.038*** (0.005)−0.039*** (0.006)−0.061*** (0.008)−0.061*** (0.006)−0.062*** (0.007)
Black × Wave II0.002 (0.008)0.002 (0.011)
|$\bar {Y}$|0.6320.6650.6650.7020.7050.705
R20.0510.0520.0520.1050.1070.107
N19,08938,16838,16812,07225,39325,393

Notes: Robust standard errors in parentheses clustered at the state/public service type level. ***p < 0.01. Dependent variable in columns (1)–(3) is a binary variable indicating whether a response to the email was provided (linear probability model) and in columns (4)–(6) is a binary variable indicating whether the sender was addressed by name or with salutations (linear probability model). |$\bar {Y}$| refers to the average response rate (columns (1)–(3)) and to the average of the cordiality outcome (columns (4)–(6)). Wave II refers to the follow-up wave where occupation is signaled in the email. Pooled waves refers to the pooling of Wave I and Wave II. All regressions include controls of column (6), Table 3.

Table 8.

Fixed socioeconomic background.

ReplyCordial reply
Wave IIPooled wavesWave IIPooled waves
Black−0.037*** (0.007)−0.038*** (0.005)−0.039*** (0.006)−0.061*** (0.008)−0.061*** (0.006)−0.062*** (0.007)
Black × Wave II0.002 (0.008)0.002 (0.011)
|$\bar {Y}$|0.6320.6650.6650.7020.7050.705
R20.0510.0520.0520.1050.1070.107
N19,08938,16838,16812,07225,39325,393
ReplyCordial reply
Wave IIPooled wavesWave IIPooled waves
Black−0.037*** (0.007)−0.038*** (0.005)−0.039*** (0.006)−0.061*** (0.008)−0.061*** (0.006)−0.062*** (0.007)
Black × Wave II0.002 (0.008)0.002 (0.011)
|$\bar {Y}$|0.6320.6650.6650.7020.7050.705
R20.0510.0520.0520.1050.1070.107
N19,08938,16838,16812,07225,39325,393

Notes: Robust standard errors in parentheses clustered at the state/public service type level. ***p < 0.01. Dependent variable in columns (1)–(3) is a binary variable indicating whether a response to the email was provided (linear probability model) and in columns (4)–(6) is a binary variable indicating whether the sender was addressed by name or with salutations (linear probability model). |$\bar {Y}$| refers to the average response rate (columns (1)–(3)) and to the average of the cordiality outcome (columns (4)–(6)). Wave II refers to the follow-up wave where occupation is signaled in the email. Pooled waves refers to the pooling of Wave I and Wave II. All regressions include controls of column (6), Table 3.

To summarize, through this exercise we fail to detect the presence of statistical discrimination.24

4.3. Relationship with Existing Racial Prejudice Measures

We next explore the correlation of our measure of discrimination with racial prejudice measures used in the literature. In particular, we considered three distinct measures: the average prejudice index used by Charles and Guryan (2008), the racially charged search rate used by Stephens-Davidowitz (2014) and an index capturing the race implicit association test created within the Harvard Project Implicit and described in Xu, Nosek, and Greenwald (2014). In Table 9 we report the results of models where we regress our discrimination index (the same that appears in Figure 3 with opposite sign) on racial prejudice indices used in the above-mentioned studies, and which are available at the state level. Despite that existing measures capture dimensions of discrimination different than ours, and that the samples and time periods are different, we find a moderate positive correlation with our index. This correlation becomes stronger when controlling for geographic area by introducing dummies for the four U.S. regions. Together with the results presented in the previous section, this evidence suggests that prejudice-based discrimination is an important explanation behind our finding.

Table 9.

Relationship with racial animus indices.

Average prejudice indexRacially charged search rateRace implicit association test
Discrimination index0.257* (0.143)0.401*** (0.097)0.187 (0.140)0.260** (0.109)0.282** (0.137)0.292*** (0.085)
R20.0700.6430.0350.5190.0800.708
N454551515151
Region dummiesNYNYNY
Average prejudice indexRacially charged search rateRace implicit association test
Discrimination index0.257* (0.143)0.401*** (0.097)0.187 (0.140)0.260** (0.109)0.282** (0.137)0.292*** (0.085)
R20.0700.6430.0350.5190.0800.708
N454551515151
Region dummiesNYNYNY

Notes: Standard errors in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. The dependent variable is indicated in the column headers. The independent variable is the index of discrimination in local public services at the state level constructed using Waves I and II. See text for details. Average prejudice index refers to the measure used in Charles and Guryan (2008); Racially charged search rate refers to the measure used in Stephens-Davidowitz (2014); Race implicit association test refers to the index created within Project Implicit and described in Xu et al. (2014).

Table 9.

Relationship with racial animus indices.

Average prejudice indexRacially charged search rateRace implicit association test
Discrimination index0.257* (0.143)0.401*** (0.097)0.187 (0.140)0.260** (0.109)0.282** (0.137)0.292*** (0.085)
R20.0700.6430.0350.5190.0800.708
N454551515151
Region dummiesNYNYNY
Average prejudice indexRacially charged search rateRace implicit association test
Discrimination index0.257* (0.143)0.401*** (0.097)0.187 (0.140)0.260** (0.109)0.282** (0.137)0.292*** (0.085)
R20.0700.6430.0350.5190.0800.708
N454551515151
Region dummiesNYNYNY

Notes: Standard errors in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. The dependent variable is indicated in the column headers. The independent variable is the index of discrimination in local public services at the state level constructed using Waves I and II. See text for details. Average prejudice index refers to the measure used in Charles and Guryan (2008); Racially charged search rate refers to the measure used in Stephens-Davidowitz (2014); Race implicit association test refers to the index created within Project Implicit and described in Xu et al. (2014).

5. Discrimination and Racial Gaps in Attitudes toward the Government and Wages

To provide an initial exploration into whether the discrimination that we found has real consequences, in this section, we explore if our measure of discrimination is associated with racial gaps in attitudes toward government and wages.

5.1. Attitudes toward Government

To analyze attitudes toward government, we use data from the American National Election Studies (ANES), an opinion survey on voting attitudes and behavior. To increase sample size and since some of the questions of interest are asked only in some years, we pooled all available waves from 1948 to 2012. We constructed several indicators ranging from trust in government to interest in elections. The details on how the variables have been constructed and the years for which they are available are reported in Table A.4 in Appendix A. We then match information on the state of residence of respondents in the ANES with our discrimination index and estimate the following regression:
(2)
where Y is the outcome of interest (e.g., faith in government) of individual i, |$ {\mathit {Discrimination\,Index}}$| is the discrimination index at the state level derived from our data (as described in Section 4.3) and |$ {\mathit {Black}}$| is a variable equal to 1 if the respondent’s reported race is black and 0 if it is white. X is a vector that includes the following control variables: sex, age, education, marital status, social class, occupation, work status, race-specific year dummies and four indicators for the region of residence. The coefficient of interest is β3, which represents how the white-black gap in the outcome of interest varies with our measure of discrimination in local public services. The results of this analysis are reported in Table 10.
Table 10.

Black-white gaps in attitudes toward government.

Faith in local governmentGovernment performance ratingGovt poor attention to peopleNot interested in elections
Black−0.101** (0.044)0.154** (0.059)−0.081* (0.046)−0.031 (0.042)−0.058 (0.042)0.135** (0.055)−0.070 (0.044)
Discrimination index−0.299 (0.260)0.161 (0.271)−0.024 (0.251)0.043 (0.263)−0.204 (0.235)0.048 (0.137)−0.216** (0.087)
Black × Discrimination index−0.548* (0.286)0.057 (0.294)−0.470* (0.253)−0.426 (0.430)−0.958** (0.454)0.441 (0.313)0.433*** (0.147)
|$\bar {Y}$|0.3530.3930.7710.7880.7000.2940.256
R20.0240.0250.0240.0320.0420.0550.091
N4,5474,1564,3144,3304,41219,87227,832
Faith in local governmentGovernment performance ratingGovt poor attention to peopleNot interested in elections
Black−0.101** (0.044)0.154** (0.059)−0.081* (0.046)−0.031 (0.042)−0.058 (0.042)0.135** (0.055)−0.070 (0.044)
Discrimination index−0.299 (0.260)0.161 (0.271)−0.024 (0.251)0.043 (0.263)−0.204 (0.235)0.048 (0.137)−0.216** (0.087)
Black × Discrimination index−0.548* (0.286)0.057 (0.294)−0.470* (0.253)−0.426 (0.430)−0.958** (0.454)0.441 (0.313)0.433*** (0.147)
|$\bar {Y}$|0.3530.3930.7710.7880.7000.2940.256
R20.0240.0250.0240.0320.0420.0550.091
N4,5474,1564,3144,3304,41219,87227,832

Notes: Robust standard errors clustered at the state level in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. Data are from the 1948–2012 American National Election Studies. The sample includes individuals aged 16 or above. The dependent variable is indicated in the column headers. The key independent variable is the index of discrimination in local public services at the state level constructed using Wave I and II. See text for details. Controls include a dummy for sex, age, race-specific year dummies, region dummies, and dummies for: education, marital status social class, occupation, and work status. Observations are weighted by the weights provided in the ANES.

Table 10.

Black-white gaps in attitudes toward government.

Faith in local governmentGovernment performance ratingGovt poor attention to peopleNot interested in elections
Black−0.101** (0.044)0.154** (0.059)−0.081* (0.046)−0.031 (0.042)−0.058 (0.042)0.135** (0.055)−0.070 (0.044)
Discrimination index−0.299 (0.260)0.161 (0.271)−0.024 (0.251)0.043 (0.263)−0.204 (0.235)0.048 (0.137)−0.216** (0.087)
Black × Discrimination index−0.548* (0.286)0.057 (0.294)−0.470* (0.253)−0.426 (0.430)−0.958** (0.454)0.441 (0.313)0.433*** (0.147)
|$\bar {Y}$|0.3530.3930.7710.7880.7000.2940.256
R20.0240.0250.0240.0320.0420.0550.091
N4,5474,1564,3144,3304,41219,87227,832
Faith in local governmentGovernment performance ratingGovt poor attention to peopleNot interested in elections
Black−0.101** (0.044)0.154** (0.059)−0.081* (0.046)−0.031 (0.042)−0.058 (0.042)0.135** (0.055)−0.070 (0.044)
Discrimination index−0.299 (0.260)0.161 (0.271)−0.024 (0.251)0.043 (0.263)−0.204 (0.235)0.048 (0.137)−0.216** (0.087)
Black × Discrimination index−0.548* (0.286)0.057 (0.294)−0.470* (0.253)−0.426 (0.430)−0.958** (0.454)0.441 (0.313)0.433*** (0.147)
|$\bar {Y}$|0.3530.3930.7710.7880.7000.2940.256
R20.0240.0250.0240.0320.0420.0550.091
N4,5474,1564,3144,3304,41219,87227,832

Notes: Robust standard errors clustered at the state level in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. Data are from the 1948–2012 American National Election Studies. The sample includes individuals aged 16 or above. The dependent variable is indicated in the column headers. The key independent variable is the index of discrimination in local public services at the state level constructed using Wave I and II. See text for details. Controls include a dummy for sex, age, race-specific year dummies, region dummies, and dummies for: education, marital status social class, occupation, and work status. Observations are weighted by the weights provided in the ANES.

The outcome in column (1) is an indicator that is equal to one if the individual has most faith in local government and zero if the individual has most faith in state/federal government. The second column considers a similar outcome, but individuals are asked about the level of government in which they have least trust. The estimates of β3 for both regressions indicate that the white-black gap in terms of faith in local government (compared to other levels of government) is larger in states where discrimination in public services is higher, albeit results are statistically significant at the 10% level only in column (1).

The outcomes in columns (3)–(5) capture individuals’ subjective rating of government’s performance. We consider all levels of government (local/state/federal) and construct an indicator that is equal to 1 if the rating is above the median and 0 otherwise. The point estimates of β3 suggest that African Americans have an even lower rating of government performance if they reside in states where the value of the discrimination index is higher. However, coefficient estimates are statistically significant for local and federal governments only.

Next, we consider individuals’ opinions about how much the government pays attention to what people think. The outcome variable is defined as 1 if the individual thinks that the government is not paying sufficient attention and 0 otherwise. Estimates suggest that while African Americans living in states where discrimination in public services is low are less likely to report a negative opinion, the opposite happens for those living in states with higher discrimination. However, the estimate of β3 is not statistically significant.

Finally, we consider the link between discrimination in local public services and voting attitudes and behavior by using an indicator that equals 1 if individuals are not interested in elections and 0 otherwise. The estimate of β3 is positive and statistically significant at conventional values, suggesting that in states with higher discrimination, African Americans are more likely to show lower political interest.25

5.2. Racial Wage Gap

To look at racial wage gap, we use data from the Current Population Survey (CPS) for individuals aged 16–64 in full-time employment. In Table 11 we relate log weekly wages to race and the discrimination index. What emerges is that African Americans earn less, both overall and looking at subsamples characterized by gender or education (above/below high school). The interactions between the black dummy and our index are all negative, indicating that the gap is wider in states displaying higher discrimination. The coefficient of the interaction is however significant only for the low-education subsample.

Table 11.

Black-white wage gaps.

AllMalesFemalesHigh school degree or belowAbove high school degree
Black−0.136*** (0.013)−0.206*** (0.017)−0.066*** (0.019)−0.125*** (0.022)−0.142*** (0.014)
Discrimination index−0.242 (0.224)−0.268 (0.228)−0.200 (0.276)−0.006 (0.241)−0.338 (0.249)
Black × Discrimination index−0.379 (0.241)−0.326 (0.321)−0.459 (0.283)−0.788* (0.394)−0.199 (0.222)
R20.3340.3240.3250.2050.283
N27,79915,10212,6979,71718,082
AllMalesFemalesHigh school degree or belowAbove high school degree
Black−0.136*** (0.013)−0.206*** (0.017)−0.066*** (0.019)−0.125*** (0.022)−0.142*** (0.014)
Discrimination index−0.242 (0.224)−0.268 (0.228)−0.200 (0.276)−0.006 (0.241)−0.338 (0.249)
Black × Discrimination index−0.379 (0.241)−0.326 (0.321)−0.459 (0.283)−0.788* (0.394)−0.199 (0.222)
R20.3340.3240.3250.2050.283
N27,79915,10212,6979,71718,082

Notes: Robust standard errors clustered at the state level in parentheses. *p < 0.10; ***p < 0.01. Data are from the 2013–2015 May CPS Merged Outgoing Rotation Group. The sample includes individuals aged 16–64 who are in full-time employment. The dependent variable is the log weekly wage. Top and bottom 1% of the wage distribution are trimmed. Controls include a dummy for sex, dummies for education categories, a quadratic on experience, year dummies and region dummies. Observations are weighted by the CPS basic final weight.

Table 11.

Black-white wage gaps.

AllMalesFemalesHigh school degree or belowAbove high school degree
Black−0.136*** (0.013)−0.206*** (0.017)−0.066*** (0.019)−0.125*** (0.022)−0.142*** (0.014)
Discrimination index−0.242 (0.224)−0.268 (0.228)−0.200 (0.276)−0.006 (0.241)−0.338 (0.249)
Black × Discrimination index−0.379 (0.241)−0.326 (0.321)−0.459 (0.283)−0.788* (0.394)−0.199 (0.222)
R20.3340.3240.3250.2050.283
N27,79915,10212,6979,71718,082
AllMalesFemalesHigh school degree or belowAbove high school degree
Black−0.136*** (0.013)−0.206*** (0.017)−0.066*** (0.019)−0.125*** (0.022)−0.142*** (0.014)
Discrimination index−0.242 (0.224)−0.268 (0.228)−0.200 (0.276)−0.006 (0.241)−0.338 (0.249)
Black × Discrimination index−0.379 (0.241)−0.326 (0.321)−0.459 (0.283)−0.788* (0.394)−0.199 (0.222)
R20.3340.3240.3250.2050.283
N27,79915,10212,6979,71718,082

Notes: Robust standard errors clustered at the state level in parentheses. *p < 0.10; ***p < 0.01. Data are from the 2013–2015 May CPS Merged Outgoing Rotation Group. The sample includes individuals aged 16–64 who are in full-time employment. The dependent variable is the log weekly wage. Top and bottom 1% of the wage distribution are trimmed. Controls include a dummy for sex, dummies for education categories, a quadratic on experience, year dummies and region dummies. Observations are weighted by the CPS basic final weight.

Overall, in this Section we find that our measure of discrimination has some correlation with attitudes toward government and racial wage gaps, with states characterized by higher discrimination displaying more negative attitudes toward government by African Americans, as well as wider wage gaps.

6. Conclusions

We carry out an email correspondence study that aims to identify whether racial discrimination exists in the provision of information regarding public services offered by local offices in the United States (school districts, libraries, sheriff offices, treasurers, job centers and county clerks). Overall, we find that requests of information coming from a person with a distinctively black name are less likely to receive a reply than those from a person with a distinctively white name. In our context, statistical discrimination is unlikely to be of first order importance and a series of tests indeed points toward the role of animus in explaining our findings.

Besides being illegal, discrimination by public service providers is particularly startling, since governments could be major players in the effort to eradicate discrimination in American society. For instance, school districts and libraries can play an important role in closing the educational achievement gap of black children. Indeed, our interest in the local level government relates to the fact that low-level bureaucrats are responsible for the implementation of policy enacted at both the federal and state level.

One criticism of correspondence studies in the labor market is that these analyses may not measure labor market discrimination that blacks experience in equilibrium. The explanation is that blacks may respond to the presence of discrimination by sorting themselves across firms (e.g., minimizing their contact with the most discriminatory ones) or adopting different job-search strategies than whites (e.g., sending more resumés, see Charles and Guryan 2011). This is less of an issue in the case of local public services, since providers are local monopolies in many cases. Thus, residents of a given locality cannot usually choose with which school district or sheriff office to interact. It is indeed true that black citizens may respond to the differential treatment that we have uncovered by becoming more vocal in asking public officials to fulfill their duties (for instance, by sending more “reminders” to unresponsive offices). However, this entails a cost, both psychologically and in terms of time. Moreover, besides “voice”, there is the alternative option of “exit” (Hirschman 1970), whereby black citizens who feel discriminated by public offices may reduce their interaction with them as much as possible, with potentially high costs in terms of the foregone consumption of public services. In our settings, we cannot investigate which type of reaction prevails. However, the analysis in the previous Section showed that discrimination is associated with less engagement with government (as measured by interest in elections).

Overcoming discriminatory practices in local public services is a complex issue. The persistence of such practices despite their illegality suggests that they will not be eradicated through a quick legislative fix. Possible interventions include hiring policies aimed at increasing diversity among the workforce or promoting racial matching between employees and the communities they serve (Lang 2015). At the practical level, instituting modes of communication with citizens that do not disclose the name of the sender (e.g., through online forms) rather than through emails could also be useful. What this paper shows is that discriminatory practices are present in terms of access to public services and that policy makers should consider such interventions.

Appendix A Data Sources and Variable Definitions

Table A.1.

Data Sources of Email addresses.

RecipientSource of email addressesAccessed/obtained
School districthttp://schoolinformation.com/November 3, 2014
Librarieshttp://www.americanlibrarydirectory.comOctober 7, 2014
Sheriffshttp://www.sheriffs.orgOctober 7, 2014
Treasurershttp://www.uscounties.orgOctober 8, 2014
Job centershttp://www.servicelocator.orgNovember 18, 2014
County clerkshttp://www.uscounties.orgOctober 8, 2014
RecipientSource of email addressesAccessed/obtained
School districthttp://schoolinformation.com/November 3, 2014
Librarieshttp://www.americanlibrarydirectory.comOctober 7, 2014
Sheriffshttp://www.sheriffs.orgOctober 7, 2014
Treasurershttp://www.uscounties.orgOctober 8, 2014
Job centershttp://www.servicelocator.orgNovember 18, 2014
County clerkshttp://www.uscounties.orgOctober 8, 2014
Table A.1.

Data Sources of Email addresses.

RecipientSource of email addressesAccessed/obtained
School districthttp://schoolinformation.com/November 3, 2014
Librarieshttp://www.americanlibrarydirectory.comOctober 7, 2014
Sheriffshttp://www.sheriffs.orgOctober 7, 2014
Treasurershttp://www.uscounties.orgOctober 8, 2014
Job centershttp://www.servicelocator.orgNovember 18, 2014
County clerkshttp://www.uscounties.orgOctober 8, 2014
RecipientSource of email addressesAccessed/obtained
School districthttp://schoolinformation.com/November 3, 2014
Librarieshttp://www.americanlibrarydirectory.comOctober 7, 2014
Sheriffshttp://www.sheriffs.orgOctober 7, 2014
Treasurershttp://www.uscounties.orgOctober 8, 2014
Job centershttp://www.servicelocator.orgNovember 18, 2014
County clerkshttp://www.uscounties.orgOctober 8, 2014
Table A.2.

Email queries by recipient.

RecipientSimple QueryComplex Query
School districtI would like to enroll my son in a school in this district and I have some questions. Could you please tell me what your opening hours are?I would like to enroll my son in a school in this district. Could you please let me know the documents I would need to do this? Do I also need an immunization record?
LibraryI would like to become a member of the library. Could you please tell me what your opening hours are?I would like to become a member of the library. Could you please explain what I need to do for this? Do I need proof of address?
SheriffaI am performing a background check on a local individual. Could you please tell me what your opening hours are?I am performing a background check on a local individual. Could you please tell me what the procedure is for a criminal record search and how much it would cost?
TreasurerI am about to purchase a house and I have some questions about property taxes. Could you please tell me what your opening hours are?I am about to purchase a house. Could you please explain how I can check whether there are unpaid taxes on the house? If there are unpaid taxes, who would be liable for them?
Job centerI am recently unemployed and have some questions about benefits. Could you please tell me what your opening hours are?I am recently unemployed. Could you tell me what conditions I need to meet to be eligible for benefits and how would I apply to receive them?
County clerkMy partner and I would like a marriage license. Could you please tell me what your opening hours are?My partner and I would like a marriage license. Could you please let me know the procedure for applying for one? Also would such a license only be valid in this county, or would it be recognized elsewhere?
RecipientSimple QueryComplex Query
School districtI would like to enroll my son in a school in this district and I have some questions. Could you please tell me what your opening hours are?I would like to enroll my son in a school in this district. Could you please let me know the documents I would need to do this? Do I also need an immunization record?
LibraryI would like to become a member of the library. Could you please tell me what your opening hours are?I would like to become a member of the library. Could you please explain what I need to do for this? Do I need proof of address?
SheriffaI am performing a background check on a local individual. Could you please tell me what your opening hours are?I am performing a background check on a local individual. Could you please tell me what the procedure is for a criminal record search and how much it would cost?
TreasurerI am about to purchase a house and I have some questions about property taxes. Could you please tell me what your opening hours are?I am about to purchase a house. Could you please explain how I can check whether there are unpaid taxes on the house? If there are unpaid taxes, who would be liable for them?
Job centerI am recently unemployed and have some questions about benefits. Could you please tell me what your opening hours are?I am recently unemployed. Could you tell me what conditions I need to meet to be eligible for benefits and how would I apply to receive them?
County clerkMy partner and I would like a marriage license. Could you please tell me what your opening hours are?My partner and I would like a marriage license. Could you please let me know the procedure for applying for one? Also would such a license only be valid in this county, or would it be recognized elsewhere?
a

Background checks are used, for instance, by prospective employers and landlords.

Table A.2.

Email queries by recipient.

RecipientSimple QueryComplex Query
School districtI would like to enroll my son in a school in this district and I have some questions. Could you please tell me what your opening hours are?I would like to enroll my son in a school in this district. Could you please let me know the documents I would need to do this? Do I also need an immunization record?
LibraryI would like to become a member of the library. Could you please tell me what your opening hours are?I would like to become a member of the library. Could you please explain what I need to do for this? Do I need proof of address?
SheriffaI am performing a background check on a local individual. Could you please tell me what your opening hours are?I am performing a background check on a local individual. Could you please tell me what the procedure is for a criminal record search and how much it would cost?
TreasurerI am about to purchase a house and I have some questions about property taxes. Could you please tell me what your opening hours are?I am about to purchase a house. Could you please explain how I can check whether there are unpaid taxes on the house? If there are unpaid taxes, who would be liable for them?
Job centerI am recently unemployed and have some questions about benefits. Could you please tell me what your opening hours are?I am recently unemployed. Could you tell me what conditions I need to meet to be eligible for benefits and how would I apply to receive them?
County clerkMy partner and I would like a marriage license. Could you please tell me what your opening hours are?My partner and I would like a marriage license. Could you please let me know the procedure for applying for one? Also would such a license only be valid in this county, or would it be recognized elsewhere?
RecipientSimple QueryComplex Query
School districtI would like to enroll my son in a school in this district and I have some questions. Could you please tell me what your opening hours are?I would like to enroll my son in a school in this district. Could you please let me know the documents I would need to do this? Do I also need an immunization record?
LibraryI would like to become a member of the library. Could you please tell me what your opening hours are?I would like to become a member of the library. Could you please explain what I need to do for this? Do I need proof of address?
SheriffaI am performing a background check on a local individual. Could you please tell me what your opening hours are?I am performing a background check on a local individual. Could you please tell me what the procedure is for a criminal record search and how much it would cost?
TreasurerI am about to purchase a house and I have some questions about property taxes. Could you please tell me what your opening hours are?I am about to purchase a house. Could you please explain how I can check whether there are unpaid taxes on the house? If there are unpaid taxes, who would be liable for them?
Job centerI am recently unemployed and have some questions about benefits. Could you please tell me what your opening hours are?I am recently unemployed. Could you tell me what conditions I need to meet to be eligible for benefits and how would I apply to receive them?
County clerkMy partner and I would like a marriage license. Could you please tell me what your opening hours are?My partner and I would like a marriage license. Could you please let me know the procedure for applying for one? Also would such a license only be valid in this county, or would it be recognized elsewhere?
a

Background checks are used, for instance, by prospective employers and landlords.

Table A.3.

Data sources of county variables.

Variable/data dataDescriptionObservational unitSourceYearWeblink
% of blacks in employmentNumber of blacks employed over total employed populationCountyAmerican Community Survey2010http://factfinder.census.gov/
% of blacks in public sectorNumber of blacks employed in public sector over total population employed in public sectorCountyAmerican Community Survey2006–2010http://www.census.gov/people/eeotabulation/data/eeotables20062010.html
% of blacks among educators, librarians and sheriffsNumber of blacks employed as Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers over total population employed in the same occupationsCountyCensus and American Community Survey2000–2015https://usa.ipums.org/usa/
% of blacks among school principalsNumber of black school principals over total number of school principalsStateNational Center for Education Statistics2011/2012https://nces.ed.gov/surveys/sass/tables/sass1112_2013313_p1s_001.asp
% of HispanicNumber of hispanic over total populationCountyCensus: Profile of general population2010http://factfinder.census.gov/
Unemployment rateNumber of unemployed people over population in labor forceCountyLocal Area Unemployment Statistics2014http://www.bls.gov/lau/#cntyaa
Average labor incomeAverage weekly wage in the U.S. dollars based on the 12-monthly employment levelsCountyQuarterly Census of Employment and Wages2014http://www.bls.gov/cew/datatoc.htm
Crime rateNumber of violent and propriety crime over total populationCountyUniform Crime Reporting Program Data2012http://enceladus.isr.umich.edu/race/racestart.asp
% of Dem votesNumber of votes given to Barack Obama over total votes during 2012 Presidential elections.CountyThe Guardian and Alaska.gov2012http://www.theguardian.com/news/datablog/2012/nov/07/us-2012-election-county-results-downloadhttp://www.elections.alaska.gov/results/12GENR/data/results.htm
UrbanizationRural corresponds to the category “Noncore”, Urban to “Large central metro, Large fringe metro, Medium metro, Small metro and Micropolitan”CountyNational Center for Health Statistics2013http://www.cdc.gov/nchs/data_access/urban_rural.htm
Variable/data dataDescriptionObservational unitSourceYearWeblink
% of blacks in employmentNumber of blacks employed over total employed populationCountyAmerican Community Survey2010http://factfinder.census.gov/
% of blacks in public sectorNumber of blacks employed in public sector over total population employed in public sectorCountyAmerican Community Survey2006–2010http://www.census.gov/people/eeotabulation/data/eeotables20062010.html
% of blacks among educators, librarians and sheriffsNumber of blacks employed as Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers over total population employed in the same occupationsCountyCensus and American Community Survey2000–2015https://usa.ipums.org/usa/
% of blacks among school principalsNumber of black school principals over total number of school principalsStateNational Center for Education Statistics2011/2012https://nces.ed.gov/surveys/sass/tables/sass1112_2013313_p1s_001.asp
% of HispanicNumber of hispanic over total populationCountyCensus: Profile of general population2010http://factfinder.census.gov/
Unemployment rateNumber of unemployed people over population in labor forceCountyLocal Area Unemployment Statistics2014http://www.bls.gov/lau/#cntyaa
Average labor incomeAverage weekly wage in the U.S. dollars based on the 12-monthly employment levelsCountyQuarterly Census of Employment and Wages2014http://www.bls.gov/cew/datatoc.htm
Crime rateNumber of violent and propriety crime over total populationCountyUniform Crime Reporting Program Data2012http://enceladus.isr.umich.edu/race/racestart.asp
% of Dem votesNumber of votes given to Barack Obama over total votes during 2012 Presidential elections.CountyThe Guardian and Alaska.gov2012http://www.theguardian.com/news/datablog/2012/nov/07/us-2012-election-county-results-downloadhttp://www.elections.alaska.gov/results/12GENR/data/results.htm
UrbanizationRural corresponds to the category “Noncore”, Urban to “Large central metro, Large fringe metro, Medium metro, Small metro and Micropolitan”CountyNational Center for Health Statistics2013http://www.cdc.gov/nchs/data_access/urban_rural.htm
Table A.3.

Data sources of county variables.

Variable/data dataDescriptionObservational unitSourceYearWeblink
% of blacks in employmentNumber of blacks employed over total employed populationCountyAmerican Community Survey2010http://factfinder.census.gov/
% of blacks in public sectorNumber of blacks employed in public sector over total population employed in public sectorCountyAmerican Community Survey2006–2010http://www.census.gov/people/eeotabulation/data/eeotables20062010.html
% of blacks among educators, librarians and sheriffsNumber of blacks employed as Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers over total population employed in the same occupationsCountyCensus and American Community Survey2000–2015https://usa.ipums.org/usa/
% of blacks among school principalsNumber of black school principals over total number of school principalsStateNational Center for Education Statistics2011/2012https://nces.ed.gov/surveys/sass/tables/sass1112_2013313_p1s_001.asp
% of HispanicNumber of hispanic over total populationCountyCensus: Profile of general population2010http://factfinder.census.gov/
Unemployment rateNumber of unemployed people over population in labor forceCountyLocal Area Unemployment Statistics2014http://www.bls.gov/lau/#cntyaa
Average labor incomeAverage weekly wage in the U.S. dollars based on the 12-monthly employment levelsCountyQuarterly Census of Employment and Wages2014http://www.bls.gov/cew/datatoc.htm
Crime rateNumber of violent and propriety crime over total populationCountyUniform Crime Reporting Program Data2012http://enceladus.isr.umich.edu/race/racestart.asp
% of Dem votesNumber of votes given to Barack Obama over total votes during 2012 Presidential elections.CountyThe Guardian and Alaska.gov2012http://www.theguardian.com/news/datablog/2012/nov/07/us-2012-election-county-results-downloadhttp://www.elections.alaska.gov/results/12GENR/data/results.htm
UrbanizationRural corresponds to the category “Noncore”, Urban to “Large central metro, Large fringe metro, Medium metro, Small metro and Micropolitan”CountyNational Center for Health Statistics2013http://www.cdc.gov/nchs/data_access/urban_rural.htm
Variable/data dataDescriptionObservational unitSourceYearWeblink
% of blacks in employmentNumber of blacks employed over total employed populationCountyAmerican Community Survey2010http://factfinder.census.gov/
% of blacks in public sectorNumber of blacks employed in public sector over total population employed in public sectorCountyAmerican Community Survey2006–2010http://www.census.gov/people/eeotabulation/data/eeotables20062010.html
% of blacks among educators, librarians and sheriffsNumber of blacks employed as Education Administrators, Librarians, Library Technicians, Library Assistants, Clerical and Sheriffs, Bailiffs, Correctional Officers, and Jailers over total population employed in the same occupationsCountyCensus and American Community Survey2000–2015https://usa.ipums.org/usa/
% of blacks among school principalsNumber of black school principals over total number of school principalsStateNational Center for Education Statistics2011/2012https://nces.ed.gov/surveys/sass/tables/sass1112_2013313_p1s_001.asp
% of HispanicNumber of hispanic over total populationCountyCensus: Profile of general population2010http://factfinder.census.gov/
Unemployment rateNumber of unemployed people over population in labor forceCountyLocal Area Unemployment Statistics2014http://www.bls.gov/lau/#cntyaa
Average labor incomeAverage weekly wage in the U.S. dollars based on the 12-monthly employment levelsCountyQuarterly Census of Employment and Wages2014http://www.bls.gov/cew/datatoc.htm
Crime rateNumber of violent and propriety crime over total populationCountyUniform Crime Reporting Program Data2012http://enceladus.isr.umich.edu/race/racestart.asp
% of Dem votesNumber of votes given to Barack Obama over total votes during 2012 Presidential elections.CountyThe Guardian and Alaska.gov2012http://www.theguardian.com/news/datablog/2012/nov/07/us-2012-election-county-results-downloadhttp://www.elections.alaska.gov/results/12GENR/data/results.htm
UrbanizationRural corresponds to the category “Noncore”, Urban to “Large central metro, Large fringe metro, Medium metro, Small metro and Micropolitan”CountyNational Center for Health Statistics2013http://www.cdc.gov/nchs/data_access/urban_rural.htm
Table A.4.

Data sources of ancillary variables.

Variable/dataDescriptionObservational unitSourceYearWeblink
Dissimilarity index (residential segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indicesCountyRacial Residential Segregation Measurement Project2000http://enceladus.isr.umich.edu/race/racestart.asp
Dissimilarity index (school segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district.School districtNational Center for Education Statistics2014/2015https://nces.ed.gov/ccd/pubschuniv.asp
Average prejudice indexBased on mean of responses to prejudice questions (see Charles and Guryan 2008 for details)StateGeneral Social Survey1972–2004Obtained from the authors
Racially charged search rateGoogle searches that include a racial epithet over total Google searchesStateGoogle Trends2014/2015http://sethsd.com/research/
Race implicit association testIndex that measures how long it takes to a person to sort associations between African-American and Euro-American faces with evaluations (good/bad). Higher level of the index mean stronger implicit preference for Euro-American faces. Observations aggregated by state. African Americans are excluded.StateHarvard Project Implicit2014https://osf.io/qhpq3/
Most (least) faith in local governmentEquals one if the individual has most (least) faith in local government and zero if the individual has most faith in state/federal government and zero otherwiseIndividualAmerican National Election Studies1968/1996http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Local/State/Federal Government performance ratingIndex ranging from 0 (lowest performance) to one (highest performance)IndividualAmerican National Election Studies1974/1980http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Government poor attention to peopleEquals one if the individual feels that government is paying not much attention to what people think and 0 otherwiseIndividualAmerican National Election Studies1964/2004http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Not interested in electionsEquals one if the individual is not much interested in the elections and 0 otherwiseIndividualAmerican National Election Studies1952/2012http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
WagesLog weekly wages of working-age populationIndividualCurrent Population Survey2011–2015https://cps.ipums.org/cps/
Variable/dataDescriptionObservational unitSourceYearWeblink
Dissimilarity index (residential segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indicesCountyRacial Residential Segregation Measurement Project2000http://enceladus.isr.umich.edu/race/racestart.asp
Dissimilarity index (school segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district.School districtNational Center for Education Statistics2014/2015https://nces.ed.gov/ccd/pubschuniv.asp
Average prejudice indexBased on mean of responses to prejudice questions (see Charles and Guryan 2008 for details)StateGeneral Social Survey1972–2004Obtained from the authors
Racially charged search rateGoogle searches that include a racial epithet over total Google searchesStateGoogle Trends2014/2015http://sethsd.com/research/
Race implicit association testIndex that measures how long it takes to a person to sort associations between African-American and Euro-American faces with evaluations (good/bad). Higher level of the index mean stronger implicit preference for Euro-American faces. Observations aggregated by state. African Americans are excluded.StateHarvard Project Implicit2014https://osf.io/qhpq3/
Most (least) faith in local governmentEquals one if the individual has most (least) faith in local government and zero if the individual has most faith in state/federal government and zero otherwiseIndividualAmerican National Election Studies1968/1996http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Local/State/Federal Government performance ratingIndex ranging from 0 (lowest performance) to one (highest performance)IndividualAmerican National Election Studies1974/1980http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Government poor attention to peopleEquals one if the individual feels that government is paying not much attention to what people think and 0 otherwiseIndividualAmerican National Election Studies1964/2004http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Not interested in electionsEquals one if the individual is not much interested in the elections and 0 otherwiseIndividualAmerican National Election Studies1952/2012http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
WagesLog weekly wages of working-age populationIndividualCurrent Population Survey2011–2015https://cps.ipums.org/cps/
Table A.4.

Data sources of ancillary variables.

Variable/dataDescriptionObservational unitSourceYearWeblink
Dissimilarity index (residential segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indicesCountyRacial Residential Segregation Measurement Project2000http://enceladus.isr.umich.edu/race/racestart.asp
Dissimilarity index (school segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district.School districtNational Center for Education Statistics2014/2015https://nces.ed.gov/ccd/pubschuniv.asp
Average prejudice indexBased on mean of responses to prejudice questions (see Charles and Guryan 2008 for details)StateGeneral Social Survey1972–2004Obtained from the authors
Racially charged search rateGoogle searches that include a racial epithet over total Google searchesStateGoogle Trends2014/2015http://sethsd.com/research/
Race implicit association testIndex that measures how long it takes to a person to sort associations between African-American and Euro-American faces with evaluations (good/bad). Higher level of the index mean stronger implicit preference for Euro-American faces. Observations aggregated by state. African Americans are excluded.StateHarvard Project Implicit2014https://osf.io/qhpq3/
Most (least) faith in local governmentEquals one if the individual has most (least) faith in local government and zero if the individual has most faith in state/federal government and zero otherwiseIndividualAmerican National Election Studies1968/1996http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Local/State/Federal Government performance ratingIndex ranging from 0 (lowest performance) to one (highest performance)IndividualAmerican National Election Studies1974/1980http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Government poor attention to peopleEquals one if the individual feels that government is paying not much attention to what people think and 0 otherwiseIndividualAmerican National Election Studies1964/2004http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Not interested in electionsEquals one if the individual is not much interested in the elections and 0 otherwiseIndividualAmerican National Election Studies1952/2012http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
WagesLog weekly wages of working-age populationIndividualCurrent Population Survey2011–2015https://cps.ipums.org/cps/
Variable/dataDescriptionObservational unitSourceYearWeblink
Dissimilarity index (residential segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indicesCountyRacial Residential Segregation Measurement Project2000http://enceladus.isr.umich.edu/race/racestart.asp
Dissimilarity index (school segregation)Calculated as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district.School districtNational Center for Education Statistics2014/2015https://nces.ed.gov/ccd/pubschuniv.asp
Average prejudice indexBased on mean of responses to prejudice questions (see Charles and Guryan 2008 for details)StateGeneral Social Survey1972–2004Obtained from the authors
Racially charged search rateGoogle searches that include a racial epithet over total Google searchesStateGoogle Trends2014/2015http://sethsd.com/research/
Race implicit association testIndex that measures how long it takes to a person to sort associations between African-American and Euro-American faces with evaluations (good/bad). Higher level of the index mean stronger implicit preference for Euro-American faces. Observations aggregated by state. African Americans are excluded.StateHarvard Project Implicit2014https://osf.io/qhpq3/
Most (least) faith in local governmentEquals one if the individual has most (least) faith in local government and zero if the individual has most faith in state/federal government and zero otherwiseIndividualAmerican National Election Studies1968/1996http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Local/State/Federal Government performance ratingIndex ranging from 0 (lowest performance) to one (highest performance)IndividualAmerican National Election Studies1974/1980http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Government poor attention to peopleEquals one if the individual feels that government is paying not much attention to what people think and 0 otherwiseIndividualAmerican National Election Studies1964/2004http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
Not interested in electionsEquals one if the individual is not much interested in the elections and 0 otherwiseIndividualAmerican National Election Studies1952/2012http://www.electionstudies.org/studypages/anes_timeseries_cdf/anes_timeseries_cdf.htm
WagesLog weekly wages of working-age populationIndividualCurrent Population Survey2011–2015https://cps.ipums.org/cps/

Appendix B Additional Tables and Figures

Table B.1.

Details of emails.

RecipientN. recipientsSent emailsUndelivered/testingFinal sample sizeEmails in sample/N. recipients (%)
Wave I
School district13,56710,8821,0099,87373
Library14,6385,3504564,89433
Sheriff3,0802,0872511,83660
Treasurer3,1431,2521231,12936
Job center3,14689015973123
veteran representative
County clerk3,1436917561620
Total40,71721,1522,07319,07947
Wave II
School district13,56710,8821,0299,85373
Library14,6385,3504204,93034
Sheriff3,0802,0872471,84060
Treasurer3,1431,2521181,13436
Job center3,14689016972123
veteran representative
County clerk3,1436918061119
Total40,71721,1522,06319,08947
RecipientN. recipientsSent emailsUndelivered/testingFinal sample sizeEmails in sample/N. recipients (%)
Wave I
School district13,56710,8821,0099,87373
Library14,6385,3504564,89433
Sheriff3,0802,0872511,83660
Treasurer3,1431,2521231,12936
Job center3,14689015973123
veteran representative
County clerk3,1436917561620
Total40,71721,1522,07319,07947
Wave II
School district13,56710,8821,0299,85373
Library14,6385,3504204,93034
Sheriff3,0802,0872471,84060
Treasurer3,1431,2521181,13436
Job center3,14689016972123
veteran representative
County clerk3,1436918061119
Total40,71721,1522,06319,08947

Notes: N. recipients refer to the existing number of recipients (i.e., potential recipients, including those with no email address). Undelivered/testing refers to emails that were not part of the final sample.

Table B.1.

Details of emails.

RecipientN. recipientsSent emailsUndelivered/testingFinal sample sizeEmails in sample/N. recipients (%)
Wave I
School district13,56710,8821,0099,87373
Library14,6385,3504564,89433
Sheriff3,0802,0872511,83660
Treasurer3,1431,2521231,12936
Job center3,14689015973123
veteran representative
County clerk3,1436917561620
Total40,71721,1522,07319,07947
Wave II
School district13,56710,8821,0299,85373
Library14,6385,3504204,93034
Sheriff3,0802,0872471,84060
Treasurer3,1431,2521181,13436
Job center3,14689016972123
veteran representative
County clerk3,1436918061119
Total40,71721,1522,06319,08947
RecipientN. recipientsSent emailsUndelivered/testingFinal sample sizeEmails in sample/N. recipients (%)
Wave I
School district13,56710,8821,0099,87373
Library14,6385,3504564,89433
Sheriff3,0802,0872511,83660
Treasurer3,1431,2521231,12936
Job center3,14689015973123
veteran representative
County clerk3,1436917561620
Total40,71721,1522,07319,07947
Wave II
School district13,56710,8821,0299,85373
Library14,6385,3504204,93034
Sheriff3,0802,0872471,84060
Treasurer3,1431,2521181,13436
Job center3,14689016972123
veteran representative
County clerk3,1436918061119
Total40,71721,1522,06319,08947

Notes: N. recipients refer to the existing number of recipients (i.e., potential recipients, including those with no email address). Undelivered/testing refers to emails that were not part of the final sample.

Table B.2.

County characteristics of recipients in sample and not in sample.

School districtLibrarySheriff
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment7.639.84***5.0211.28***7.777.89
(13.28)(14.06)(9.72)(16.15)(13.02)(13.83)
Unemployment rate (%)6.236.68***5.956.66***6.116.50***
(2.29)(2.38)(2.15)(2.42)(2.19)(2.44)
% of Hispanic8.268.538.647.85*8.707.69**
(12.98)(15.29)(13.55)(12.72)(13.5)(12.72)
Average labor income (USD)716715729701***721710
(190)(201)(199)(179)(186)(197)
Crime rate (%)2.422.25*2.272.56***2.482.29***
(1.48)(1.64)(1.37)(1.62)(1.52)(1.44)
% of Dem votes38.7536.90*38.8538.2638.7738.33
(14.76)(15.43)(14.49)(15.24)(14.35)(15.48)
Urbanization58.4347.97***58.4056.4461.1152.49***
(49.29)(50.05)(49.3)(49.6)(48.76)(49.96)
N. counties2,8722711,7381,4051,8361,307
School districtLibrarySheriff
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment7.639.84***5.0211.28***7.777.89
(13.28)(14.06)(9.72)(16.15)(13.02)(13.83)
Unemployment rate (%)6.236.68***5.956.66***6.116.50***
(2.29)(2.38)(2.15)(2.42)(2.19)(2.44)
% of Hispanic8.268.538.647.85*8.707.69**
(12.98)(15.29)(13.55)(12.72)(13.5)(12.72)
Average labor income (USD)716715729701***721710
(190)(201)(199)(179)(186)(197)
Crime rate (%)2.422.25*2.272.56***2.482.29***
(1.48)(1.64)(1.37)(1.62)(1.52)(1.44)
% of Dem votes38.7536.90*38.8538.2638.7738.33
(14.76)(15.43)(14.49)(15.24)(14.35)(15.48)
Urbanization58.4347.97***58.4056.4461.1152.49***
(49.29)(50.05)(49.3)(49.6)(48.76)(49.96)
N. counties2,8722711,7381,4051,8361,307
TreasurerJob center veteran representativeCounty clerk
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment3.979.97***10.047.24***3.848.79***
(8.52)(15)(13.63)(13.23)(6.41)(14.4)
Unemployment rate (%)5.536.69***6.376.246.126.31*
(2.1)(2.31)(2.04)(2.37)(1.92)(2.39)
% of Hispanic10.527.03***9.228.04**10.497.75***
(15.86)(11.24)(12.71)(13.31)(14.84)(12.7)
Average labor income (USD)712719803694***713717
(175)(199)(213)(178)(188)(191)
Crime rate (%)2.182.52***3.442.13***2.412.40
(1.42)(1.52)(1.49)(1.37)(1.33)(1.53)
% of Dem votes36.5539.73***44.7536.98***34.9639.47***
(14.44)(14.92)(14.36)(14.53)(13.6)(14.98)
Urbanization53.5959.73***86.8849.90***56.6657.74
(49.89)(49.06)(33.79)(50.01)(49.6)(49.41)
N. counties1,1292,0146482,4956162,527
TreasurerJob center veteran representativeCounty clerk
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment3.979.97***10.047.24***3.848.79***
(8.52)(15)(13.63)(13.23)(6.41)(14.4)
Unemployment rate (%)5.536.69***6.376.246.126.31*
(2.1)(2.31)(2.04)(2.37)(1.92)(2.39)
% of Hispanic10.527.03***9.228.04**10.497.75***
(15.86)(11.24)(12.71)(13.31)(14.84)(12.7)
Average labor income (USD)712719803694***713717
(175)(199)(213)(178)(188)(191)
Crime rate (%)2.182.52***3.442.13***2.412.40
(1.42)(1.52)(1.49)(1.37)(1.33)(1.53)
% of Dem votes36.5539.73***44.7536.98***34.9639.47***
(14.44)(14.92)(14.36)(14.53)(13.6)(14.98)
Urbanization53.5959.73***86.8849.90***56.6657.74
(49.89)(49.06)(33.79)(50.01)(49.6)(49.41)
N. counties1,1292,0146482,4956162,527

Notes: Standard deviations in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. p-values refer to the statistical significance of the two-sample t-statistic for the difference between the mean characteristics of “In sample” and “Not in sample” counties.

Table B.2.

County characteristics of recipients in sample and not in sample.

School districtLibrarySheriff
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment7.639.84***5.0211.28***7.777.89
(13.28)(14.06)(9.72)(16.15)(13.02)(13.83)
Unemployment rate (%)6.236.68***5.956.66***6.116.50***
(2.29)(2.38)(2.15)(2.42)(2.19)(2.44)
% of Hispanic8.268.538.647.85*8.707.69**
(12.98)(15.29)(13.55)(12.72)(13.5)(12.72)
Average labor income (USD)716715729701***721710
(190)(201)(199)(179)(186)(197)
Crime rate (%)2.422.25*2.272.56***2.482.29***
(1.48)(1.64)(1.37)(1.62)(1.52)(1.44)
% of Dem votes38.7536.90*38.8538.2638.7738.33
(14.76)(15.43)(14.49)(15.24)(14.35)(15.48)
Urbanization58.4347.97***58.4056.4461.1152.49***
(49.29)(50.05)(49.3)(49.6)(48.76)(49.96)
N. counties2,8722711,7381,4051,8361,307
School districtLibrarySheriff
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment7.639.84***5.0211.28***7.777.89
(13.28)(14.06)(9.72)(16.15)(13.02)(13.83)
Unemployment rate (%)6.236.68***5.956.66***6.116.50***
(2.29)(2.38)(2.15)(2.42)(2.19)(2.44)
% of Hispanic8.268.538.647.85*8.707.69**
(12.98)(15.29)(13.55)(12.72)(13.5)(12.72)
Average labor income (USD)716715729701***721710
(190)(201)(199)(179)(186)(197)
Crime rate (%)2.422.25*2.272.56***2.482.29***
(1.48)(1.64)(1.37)(1.62)(1.52)(1.44)
% of Dem votes38.7536.90*38.8538.2638.7738.33
(14.76)(15.43)(14.49)(15.24)(14.35)(15.48)
Urbanization58.4347.97***58.4056.4461.1152.49***
(49.29)(50.05)(49.3)(49.6)(48.76)(49.96)
N. counties2,8722711,7381,4051,8361,307
TreasurerJob center veteran representativeCounty clerk
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment3.979.97***10.047.24***3.848.79***
(8.52)(15)(13.63)(13.23)(6.41)(14.4)
Unemployment rate (%)5.536.69***6.376.246.126.31*
(2.1)(2.31)(2.04)(2.37)(1.92)(2.39)
% of Hispanic10.527.03***9.228.04**10.497.75***
(15.86)(11.24)(12.71)(13.31)(14.84)(12.7)
Average labor income (USD)712719803694***713717
(175)(199)(213)(178)(188)(191)
Crime rate (%)2.182.52***3.442.13***2.412.40
(1.42)(1.52)(1.49)(1.37)(1.33)(1.53)
% of Dem votes36.5539.73***44.7536.98***34.9639.47***
(14.44)(14.92)(14.36)(14.53)(13.6)(14.98)
Urbanization53.5959.73***86.8849.90***56.6657.74
(49.89)(49.06)(33.79)(50.01)(49.6)(49.41)
N. counties1,1292,0146482,4956162,527
TreasurerJob center veteran representativeCounty clerk
In sampleNot in sampleIn sampleNot in sampleIn sampleNot in sample
% of blacks in employment3.979.97***10.047.24***3.848.79***
(8.52)(15)(13.63)(13.23)(6.41)(14.4)
Unemployment rate (%)5.536.69***6.376.246.126.31*
(2.1)(2.31)(2.04)(2.37)(1.92)(2.39)
% of Hispanic10.527.03***9.228.04**10.497.75***
(15.86)(11.24)(12.71)(13.31)(14.84)(12.7)
Average labor income (USD)712719803694***713717
(175)(199)(213)(178)(188)(191)
Crime rate (%)2.182.52***3.442.13***2.412.40
(1.42)(1.52)(1.49)(1.37)(1.33)(1.53)
% of Dem votes36.5539.73***44.7536.98***34.9639.47***
(14.44)(14.92)(14.36)(14.53)(13.6)(14.98)
Urbanization53.5959.73***86.8849.90***56.6657.74
(49.89)(49.06)(33.79)(50.01)(49.6)(49.41)
N. counties1,1292,0146482,4956162,527

Notes: Standard deviations in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. p-values refer to the statistical significance of the two-sample t-statistic for the difference between the mean characteristics of “In sample” and “Not in sample” counties.

Table B.3.

Response rates—by sending name.

DeShawn JacksonTyrone WashingtonTotal BlackGreg WalshJake MuellerTotal White
Response rate69.0566.9167.9671.5771.7471.66
(46.23)(47.06)(46.67)(45.11)(45.03)(45.07)
N4,6374,8359,4724,9184,6899,607
Difference within race (abs) 2.15 0.17
z-stat (p-value)0.0250.855
Difference B–W−2.60−4.75
z-stat (p-value)0.0010.000
DeShawn JacksonTyrone WashingtonTotal BlackGreg WalshJake MuellerTotal White
Response rate69.0566.9167.9671.5771.7471.66
(46.23)(47.06)(46.67)(45.11)(45.03)(45.07)
N4,6374,8359,4724,9184,6899,607
Difference within race (abs) 2.15 0.17
z-stat (p-value)0.0250.855
Difference B–W−2.60−4.75
z-stat (p-value)0.0010.000

Notes: Figures refer to response rates multiplied by 100. Standard deviations in parentheses.

Table B.3.

Response rates—by sending name.

DeShawn JacksonTyrone WashingtonTotal BlackGreg WalshJake MuellerTotal White
Response rate69.0566.9167.9671.5771.7471.66
(46.23)(47.06)(46.67)(45.11)(45.03)(45.07)
N4,6374,8359,4724,9184,6899,607
Difference within race (abs) 2.15 0.17
z-stat (p-value)0.0250.855
Difference B–W−2.60−4.75
z-stat (p-value)0.0010.000
DeShawn JacksonTyrone WashingtonTotal BlackGreg WalshJake MuellerTotal White
Response rate69.0566.9167.9671.5771.7471.66
(46.23)(47.06)(46.67)(45.11)(45.03)(45.07)
N4,6374,8359,4724,9184,6899,607
Difference within race (abs) 2.15 0.17
z-stat (p-value)0.0250.855
Difference B–W−2.60−4.75
z-stat (p-value)0.0010.000

Notes: Figures refer to response rates multiplied by 100. Standard deviations in parentheses.

Table B.4.

Response rates—by type of recipient.

School districtLibrarySheriffTreasurerJob centerCounty clerkTotal
White76.5169.0853.2373.9071.9365.7271.66
(42.4)(46.23)(49.92)(43.96)(44.99)(47.54)(45.07)
Black73.1064.9646.2669.5773.0864.0967.96
(44.35)(47.72)(49.89)(46.05)(44.42)(48.05)(46.67)
Difference B–W−3.41−4.12−6.98−4.331.14−1.63−3.70
z-stat (p-value)0.0000.0020.0030.1070.7300.6720.000
School districtLibrarySheriffTreasurerJob centerCounty clerkTotal
White76.5169.0853.2373.9071.9365.7271.66
(42.4)(46.23)(49.92)(43.96)(44.99)(47.54)(45.07)
Black73.1064.9646.2669.5773.0864.0967.96
(44.35)(47.72)(49.89)(46.05)(44.42)(48.05)(46.67)
Difference B–W−3.41−4.12−6.98−4.331.14−1.63−3.70
z-stat (p-value)0.0000.0020.0030.1070.7300.6720.000

Notes: Figures refer to response rates multiplied by 100. Standard deviations in parentheses.

Table B.4.

Response rates—by type of recipient.

School districtLibrarySheriffTreasurerJob centerCounty clerkTotal
White76.5169.0853.2373.9071.9365.7271.66
(42.4)(46.23)(49.92)(43.96)(44.99)(47.54)(45.07)
Black73.1064.9646.2669.5773.0864.0967.96
(44.35)(47.72)(49.89)(46.05)(44.42)(48.05)(46.67)
Difference B–W−3.41−4.12−6.98−4.331.14−1.63−3.70
z-stat (p-value)0.0000.0020.0030.1070.7300.6720.000
School districtLibrarySheriffTreasurerJob centerCounty clerkTotal
White76.5169.0853.2373.9071.9365.7271.66
(42.4)(46.23)(49.92)(43.96)(44.99)(47.54)(45.07)
Black73.1064.9646.2669.5773.0864.0967.96
(44.35)(47.72)(49.89)(46.05)(44.42)(48.05)(46.67)
Difference B–W−3.41−4.12−6.98−4.331.14−1.63−3.70
z-stat (p-value)0.0000.0020.0030.1070.7300.6720.000

Notes: Figures refer to response rates multiplied by 100. Standard deviations in parentheses.

Table B.5.

Other outcomes—summary statistics.

BlackWhitet-test (p-value)
Number of replies1.031.030.78
(0.18)(0.19)
[1–3][1–6]
Length of reply (# words)171.4170.70.68
(99.2)(101.2)
[0–4213][2–5324]
Cordial reply0.6790.7350
(0.467)(0.441)
[0–1][0–1]
Delay in reply (# hours)24.225.20.41
(66.8)(73.9)
[0–960][0–960]
BlackWhitet-test (p-value)
Number of replies1.031.030.78
(0.18)(0.19)
[1–3][1–6]
Length of reply (# words)171.4170.70.68
(99.2)(101.2)
[0–4213][2–5324]
Cordial reply0.6790.7350
(0.467)(0.441)
[0–1][0–1]
Delay in reply (# hours)24.225.20.41
(66.8)(73.9)
[0–960][0–960]

Notes: N = 13,321. Cordial reply refers to whether the sender was addressed by name or with salutations. Standard deviations in parentheses. Values in square brackets represent the min and max, respectively.

Table B.5.

Other outcomes—summary statistics.

BlackWhitet-test (p-value)
Number of replies1.031.030.78
(0.18)(0.19)
[1–3][1–6]
Length of reply (# words)171.4170.70.68
(99.2)(101.2)
[0–4213][2–5324]
Cordial reply0.6790.7350
(0.467)(0.441)
[0–1][0–1]
Delay in reply (# hours)24.225.20.41
(66.8)(73.9)
[0–960][0–960]
BlackWhitet-test (p-value)
Number of replies1.031.030.78
(0.18)(0.19)
[1–3][1–6]
Length of reply (# words)171.4170.70.68
(99.2)(101.2)
[0–4213][2–5324]
Cordial reply0.6790.7350
(0.467)(0.441)
[0–1][0–1]
Delay in reply (# hours)24.225.20.41
(66.8)(73.9)
[0–960][0–960]

Notes: N = 13,321. Cordial reply refers to whether the sender was addressed by name or with salutations. Standard deviations in parentheses. Values in square brackets represent the min and max, respectively.

Appendix C Additional Analysis

Difference in response rates by census divisions. Black/white gap in response rate is obtained by estimating the model of column (4) in Table 3 for each Census Division. Bars represent confidence intervals. NE includes Connecticut, Maine, Massachusetts, New Hampshire, Rhode Island and Vermont; MA includes New Jersey, New York and Pennsylvania; ENC includes Illinois, Indiana, Michigan, Ohio and Wisconsin; WNC includes Iowa, Kansas, Minnesota, Missouri, Nebraska, North Dakota and South Dakota; SA includes Delaware, District of Columbia, Florida, Georgia, Maryland, North Carolina, South Carolina, Virginia and West Virginia; ESC includes Alabama, Kentucky, Mississippi and Tennessee; WSC includes Arkansas, Louisiana, Oklahoma and Texas; MO includes Arizona, Colorado, Idaho, Montana, Nevada, New Mexico, Utah and Wyoming; PA includes Alaska, California, Hawaii, Oregon and Washington.
Figure C.1.

Difference in response rates by census divisions. Black/white gap in response rate is obtained by estimating the model of column (4) in Table 3 for each Census Division. Bars represent confidence intervals. NE includes Connecticut, Maine, Massachusetts, New Hampshire, Rhode Island and Vermont; MA includes New Jersey, New York and Pennsylvania; ENC includes Illinois, Indiana, Michigan, Ohio and Wisconsin; WNC includes Iowa, Kansas, Minnesota, Missouri, Nebraska, North Dakota and South Dakota; SA includes Delaware, District of Columbia, Florida, Georgia, Maryland, North Carolina, South Carolina, Virginia and West Virginia; ESC includes Alabama, Kentucky, Mississippi and Tennessee; WSC includes Arkansas, Louisiana, Oklahoma and Texas; MO includes Arizona, Colorado, Idaho, Montana, Nevada, New Mexico, Utah and Wyoming; PA includes Alaska, California, Hawaii, Oregon and Washington.

Table C.1.

Cordiality in response—by type of public service.

School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.060***−0.047***−0.063**−0.135***−0.037−0.098*
(0.009)(0.014)(0.029)(0.031)(0.047)(0.051)
|$\bar {Y}$|0.7710.7220.4620.5030.6430.502
R20.0880.0690.1680.1430.1740.192
N7,3853,281914811530400
School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.060***−0.047***−0.063**−0.135***−0.037−0.098*
(0.009)(0.014)(0.029)(0.031)(0.047)(0.051)
|$\bar {Y}$|0.7710.7220.4620.5030.6430.502
R20.0880.0690.1680.1430.1740.192
N7,3853,281914811530400

Notes: Robust standard errors in parentheses clustered at the state level. *p < 0.10; **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether the sender was addressed by name or with salutations (linear probability model). |$\bar{Y}$| refers to the average of the cordiality outcome. All regressions include controls of column (4), Table 3.

Table C.1.

Cordiality in response—by type of public service.

School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.060***−0.047***−0.063**−0.135***−0.037−0.098*
(0.009)(0.014)(0.029)(0.031)(0.047)(0.051)
|$\bar {Y}$|0.7710.7220.4620.5030.6430.502
R20.0880.0690.1680.1430.1740.192
N7,3853,281914811530400
School districtLibrarySheriffTreasurerJob centerCounty clerk
Black−0.060***−0.047***−0.063**−0.135***−0.037−0.098*
(0.009)(0.014)(0.029)(0.031)(0.047)(0.051)
|$\bar {Y}$|0.7710.7220.4620.5030.6430.502
R20.0880.0690.1680.1430.1740.192
N7,3853,281914811530400

Notes: Robust standard errors in parentheses clustered at the state level. *p < 0.10; **p < 0.05; ***p < 0.01. Dependent variable is a binary variable indicating whether the sender was addressed by name or with salutations (linear probability model). |$\bar{Y}$| refers to the average of the cordiality outcome. All regressions include controls of column (4), Table 3.

Table C.2.

Residential and school segregation.

ResidentialSchool
Black−0.038***−0.038***−0.031***−0.031***
(0.006)(0.006)(0.010)(0.011)
Segregation index−0.0050.004−0.001−0.008
(0.005)(0.006)(0.006)(0.007)
Black × Segregation index−0.018***0.015
(0.006)(0.014)
R20.0490.0500.0400.041
N19,07919,0795,2165,216
ResidentialSchool
Black−0.038***−0.038***−0.031***−0.031***
(0.006)(0.006)(0.010)(0.011)
Segregation index−0.0050.004−0.001−0.008
(0.005)(0.006)(0.006)(0.007)
Black × Segregation index−0.018***0.015
(0.006)(0.014)
R20.0490.0500.0400.041
N19,07919,0795,2165,216

Notes: Robust standard errors in parentheses clustered at the state/recipient level. ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model).

All regressions include controls of column (4), Table 3. Residential segregation is measured using the dissimilarity index for all counties. The index has been obtained from the Racial Residential Segregation Measurement Project website and is defined as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indices (see http://enceladus.isr.umich.edu/race/racestart.asp for details).

School segregation is measured using the dissimilarity index for school districts obtained from the 2014–15 Common Core of Data from the National Center for Education Statistics. Districts with less than 10 black students have been dropped. The index of dissimilarity is defined as previously, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district. Both indices of segregation have been standardized.

Table C.2.

Residential and school segregation.

ResidentialSchool
Black−0.038***−0.038***−0.031***−0.031***
(0.006)(0.006)(0.010)(0.011)
Segregation index−0.0050.004−0.001−0.008
(0.005)(0.006)(0.006)(0.007)
Black × Segregation index−0.018***0.015
(0.006)(0.014)
R20.0490.0500.0400.041
N19,07919,0795,2165,216
ResidentialSchool
Black−0.038***−0.038***−0.031***−0.031***
(0.006)(0.006)(0.010)(0.011)
Segregation index−0.0050.004−0.001−0.008
(0.005)(0.006)(0.006)(0.007)
Black × Segregation index−0.018***0.015
(0.006)(0.014)
R20.0490.0500.0400.041
N19,07919,0795,2165,216

Notes: Robust standard errors in parentheses clustered at the state/recipient level. ***p < 0.01. Dependent variable is a binary variable indicating whether a response to the email was provided (linear probability model).

All regressions include controls of column (4), Table 3. Residential segregation is measured using the dissimilarity index for all counties. The index has been obtained from the Racial Residential Segregation Measurement Project website and is defined as |$\frac{1}{2}\sum _i\left|\frac{b_i}{B}-\frac{w_i}{W}\right|$|⁠, where bi is the black population of block i, B is the total black population in the tract, wi is the white population of block i, W is the total white population in the tract. The county-level index is obtained as a weighted average of the tract-level dissimilarity indices (see http://enceladus.isr.umich.edu/race/racestart.asp for details).

School segregation is measured using the dissimilarity index for school districts obtained from the 2014–15 Common Core of Data from the National Center for Education Statistics. Districts with less than 10 black students have been dropped. The index of dissimilarity is defined as previously, where bi is the number of black students of school i, B is the number of black students in the school district, wi is the number of white students of school i, W is the number of white students in the school district. Both indices of segregation have been standardized.

Appendix D Framework for Public Official’s Decision Problem

Here, we sketch a simple analytical framework, along the lines of Neumark (2012) and Heckman (1998), to think about the decision-making of a public official who has received an email and needs to decide whether to answer or not.

Suppose that the public official applies the following decision rule when it comes to responding to email queries: a response will be provided if the perceived cost of the response is below a certain threshold c. The cost here can be associated with the effort that the official would need to exert if the citizen asking the initial question (e.g., opening hours of library), comes back with further questions or actually decides to visit the office and interact with the official. In this perspective, the official does not respond to citizens that are likely to be very demanding in terms of the official’s time and effort in future interactions.26

Let us denote the fussiness of the citizen by F and suppose that fussiness depends on the citizen’s characteristics, X. The treatment that the citizen receives, T, will depend on the fussiness of the citizen and possibly also on the race, R (with R = B for blacks and R = W for whites). Let us assume for simplicity that T(F(X), R) = X + γIR, with IR = 1 if R = B and IR = 0 if R = W, and γ > 0 capturing taste-based discrimination against African Americans. The treatment in this example is continuous. However, in our setting the treatment of senders is dichotomous (reply or not reply). As mentioned, this can be modeled through a cut-off rule, so that a response is offered (T = 1) if the perceived cost of the response is below a certain threshold:
(D.1)
and
(D.2)
where c is the cost of effort for the official, γ is the taste-based discrimination factor, and E(XW), E(XB) are, respectively, the expected personal characteristics of citizens with white- and black-sounding names.

The difference in responses to whites and blacks in wave 1 (what we refer to as the racial gap) is ΔTwave1 = T(F(XW), W) − T(F(XB), B) = E(XW) − E(XB) − γ, and is a combination of taste-based discrimination, γ, and statistical discrimination, E(XW) − E(XB).

In wave 2, we attempt to affect the extent of statistical discrimination, E(XW) − E(XB), present in wave 1. The logic of what we do in wave 2 is to try to change the term E(XW) − E(XB) by adding information about the identity of the sender. Then, if we see the racial gap change across the two waves, we can deduce that this change can be attributed to a change in the extent of statistical discrimination across the two waves and, thus, obtain a lower (upper) bound for statistical (taste-based) discrimination.27 On the other hand, taste-based discrimination depends only on the perceived race of the sender and, thus, is insensitive to additional information. From now on, to make the argument sharper we assume a continuous treatment.28 The intuition that information about socioeconomic background may affect only statistical discrimination holds, however, also to the case with dichotomous treatment. This is because statistical discrimination depends on information other than race, whereas taste-based discrimination should depend only on information about race. Indicating with |$E(X_{W}| {\mathit {Real\, Estate}})$| and with |$E(X_{B}| {\mathit {Real\, Estate}})$| the expected fussiness when the real estate signal is present of an agent with a white and black sounding name respectively, then we should consider three cases.

Case (i):
(D.3)
that is, the official expects real estate agents to be closer in terms of expected fussiness than wave 1 senders. In this case, we would expect to see a reduction in the racial gap comparing wave 1 to wave 2, and this reduction would be evidence of the presence of statistical discrimination.
Case (ii):
(D.4)
that is, the official expects real estate agents to be further apart in terms of expected fussiness than wave 1 senders. In this case, we expect to find an increase in the racial gap comparing wave 1 to wave 2, and this increase would, again, be evidence of the presence of statistical discrimination.
Case (iii):
(D.5)
that is, there is a parallel shift in terms of expected fussiness. In this knife-edge case, we would expect to find no change in the racial gap, regardless of the presence or not of statistical discrimination, and comparing wave 1 to wave 2 would not provide any evidence regarding the presence of statistical discrimination.

Notice that what has been discussed previously is true also if the signal is negative, meaning that a real estate agent of a given race is expected to be more fussy than a generic sender of the same race, that is, |$E(X_{W}| {\mathit {Real\, Estate}})>E(X_{W})$| and |$E(X_{B}| {\mathit {Real\, Estate}})>E(X_{B})$|⁠. This would reduce the probability of responses in the second wave, which is something that we indeed find, but would still allow us to detect the presence of statistical discrimination by comparing wave 1 to wave 2, as long as we are not in case (iii), that is, as long as |$E(X_{W}| {\mathit {Real\, Estate}})-E(X_{B}| {\mathit {Real\, Estate}}) \ne E(X_{W})-E(X_{B})$|⁠.

To summarize, as long as the change in the perceived fussiness of a black citizen when the real estate identity is attached is different from that of his white counterpart, we can still detect the presence and provide a lower bound for the importance of statistical discrimination by comparing the racial gap in response rates across waves.

Finding, as we do, that the racial gap is constant across waves is consistent with absence of statistical discrimination if |$E(X_{W}| {\mathit {Real\, Estate}})-E(X_{B}| {\mathit {Real\, Estate}}) <E(X_{W})-E(X_{B})$| or |$E(X_{W}| {\mathit {Real\, Estate}})-E(X_{B}| {\mathit {Real\, Estate}})>E(X_{W})-E(X_{B})$|⁠. If, instead, |$E(X_{W}| {\mathit {Real\, Estate}})-E(X_{B}| {\mathit {Real\, Estate}})=E(X_{W})-E(X_{B})$| or if the signal goes completely unnoticed, then comparing the two waves is not informative about the presence or not of statistical discrimination.

Acknowledgments

We would like to thank the Editor Daniele Paserman and three anonymous referees for very constructive comments. We also thank Matthew Blackwell, Raj Chetty, Rajeev Dehejia, Stefano DellaVigna, Uri Gneezy, Jonathan Guryan, Nathaniel Hilger, Guillermina Jasso, Gary King, Peter Kuhn, Uwe Sunde and Adam Szeidl for useful discussions. We also thank participants of seminars at IZA, Central European University, Temple, Köln, Newcastle, Surrey, Innsbruck, Verona, Rotterdam, and participants of the 2015 Society for Government Economists Conference, the Workshop on the Economics of Discrimination in Naples, the 2016 Royal Economic Society Conference, the 39th NBER Summer Institute, the 33rd European Association of Law and Economics for their comments. We thank Kerwin Kofi Charles and Jonathan Guryan for kindly providing us with their data. This project has received ethical approval from the Institute for the Study of Labor (IZA) in Bonn, Germany, and from the University of Southampton.

Notes

The editor in charge of this paper was M. Daniele Paserman.

Footnotes

1

Altonji and Blank (1999, Chap. 48) provide an overview of race differential in the labor market. Fryer (2011, Chap. 10) focuses on the racial achievement gap in education. Sabol, West, and Cooper (2009) provide figures about incarceration by race. CDC (2011) reports on race disparities in mortality and morbidity.

2

Charles and Guryan (2011) discuss research on discrimination against blacks in labor market outcomes. Alesina and La Ferrara (2014) show evidence of racial bias in capital sentencing. Ewens, Tomlin, and Wang (2014) is a recent contribution on discrimination in housing. Product market discrimination is studied, for instance, by Doleac and Stein (2013).

3

A nationally representative survey by the Pew Research Center (2013) finds that over half of Americans aged 16 and older have used a public library in some way in the previous 12 months, with many using facilities provided by libraries for purposes related to education (42%, e.g., taking online classes or working on assignments and schoolwork), employment (40%, e.g., searching for job opportunities, submitting online job applications or working on resumes), and health (37%, e.g., learning about medical conditions, finding health care providers, and assessing health insurance options). Many also report using a library computer to download government forms or find out about a government program or service. Interestingly, the study shows that library services are particularly important to “[w]omen, African Americans and Hispanics, adults who live in lower-income households, and adults with lower levels of educational attainment”.

4

County clerks are generally responsible for keeping records of deeds and marriage licenses and most other public records. They also issue many licenses and often have responsibilities for elections, including the preparation of ballots and the recruitment and training of poll workers. County treasurer offices’ responsibilities include, for instance, the issuance of vehicle titles and registrations, the collection of vehicle fees, and the collection of property taxes for local governments. The responsibilities of school districts may include the selection of textbooks and other curriculum materials, the hiring and dismissal of staff, the monitoring of finances, ensuring compliance with relevant laws and the maintenance of school buildings. Sheriff offices have a range of duties that include criminal investigations, traffic enforcement, and operation of the jail. Their responsibilities may include serving warrants and evictions.

5

See Riach and Rich (2002), Guryan and Charles (2013), Rich (2014), Neumark (2016), and Bertrand and Duflo (2017), for earlier and more recent reviews of the literature.

6

A small random sample was used for testing; about 2,000 emails were eliminated because they were undelivered. We checked and corroborated that the probability that an email is eliminated does not correlate with our key variables.

7

Most of our email addresses are of the “personal” type rather than “generic”, that is, they include the name or surname of the receiver and are not, for instance, of the type “info@...” or “office@...”. We do not know, however, who the actual reader is. It could well be the case that an email addressed to the sheriff is actually read by a deputy or a personal assistant.

8

In their analysis of the distribution of first names in California, Fryer and Levitt (2004) find that the first name Tyrone is slightly more represented among whites relative to DeShawn. In particular, they report that “[t]here are 463 children named DeShawn, 458 of whom are Black. The name Tyrone is given to 502 Black boys and only 17 Whites.” (Fryer and Levitt 2004, p. 770).

9

Two further checks that we perform concern the functional form and the email structure. First, we estimated the baseline specification using a probit model. The marginal effect (for the baseline −0.040, s.e. 0.006) is remarkably similar to the estimate of the linear probability model, reassuring us that results are not sensitive to the chosen functional form. Second, we excluded from the sample emails with a generic structure (i.e., “office@...”, “admin@...”). When performing a regression in the resulting sample (15,851 observations), we find a coefficient estimate of −0.033 (s.e. 0.007).

10

In unreported analysis, we estimated a regression model that attributes equal importance to each service. We achieve this by weighting observations by the ratio of the total number of emails sent to the number of emails of each type of public service. The estimated coefficient (−0.032, s.e. 0.012) is not too dissimilar from that of the unweighted regressions, showing that the differential treatment between black and white emails is robust to giving equal weight to each of the six services.

11

The state composition of each region is the following: North-East includes Connecticut, Maine, Massachusetts, New Hampshire, Rhode Island, and Vermont; Mid-West includes Illinois, Indiana, Michigan, Ohio, Wisconsin, Iowa, Kansas, Minnesota, Missouri, Nebraska, North Dakota, and South Dakota; South includes Delaware, Florida, Georgia, Maryland, North Carolina, South Carolina, Virginia, Washington, D.C., West Virginia, Alabama, Kentucky, Mississippi, Tennessee, Arkansas, Louisiana, Oklahoma, and Texas; West includes Arizona, Colorado, Idaho, Montana, Nevada, New Mexico, Utah, Wyoming, Alaska, California, Hawaii, Oregon, and Washington.

12

When we split the sample according to the 9 Census Divisions (see Figure C.1), all point estimates for the black dummy are negative albeit some of them are not statistically significant.

13

We apply the six-level classification developed by the National Center for Health Statistics: Large central metro, Large fringe metro, Medium metro, Small metro, Micropolitan, and Noncore. We designate the last category as rural.

14

For salutations, we search the text for the following keywords “Hi”, “Mr”, “Dear”, “Hello”, “Good”, “Thank”.

15

For robustness, we also constructed an alternative definition of cordial reply, defined as 0.5 × (#cordial words + 0.5 × (#characters of all cordial words), that takes more into account the “intensive” margin of cordiality. This variable produces a coefficient estimate of −0.110 (s.e. 0.030).

16

To improve readability, we excluded from the graph Washington D.C., where only 44 emails where sent (23 in wave I and 21 in wave II). In Washington D.C. the share of blacks in employment is 38% (vis-à-vis 8% at the national level) and the share of blacks in public employment is 34% (whereas only 11% for the whole the United States). In any case, including Washington D.C. does not change the slope of the regression line in the figure.

17

The correlation between the first two measures is 0.91. Note that, with the exception of the share of blacks in employment, data are available only for a subset of counties and states. The fact that the estimate in column (3) is lower than our baseline is not surprising, given that the available counties are all classified as urban areas, where we know that the racial gap is relatively less pronounced.

18

For example, moving from the 1st to the 3rd quartile of the share of blacks in employment (column (1)) implies a reduction in the response rate of nearly 2 percentage points (from 71.19% to 69.55%).

19

In particular, in the case of the model with the share of blacks in employment, the estimate for the baseline category (1st quartile) is −0.073 (s.e. 0.014) and the estimates for the interactions between the 2nd, 3rd, and 4th quartiles and the black dummy are: 0.028 (s.e. 0.017), 0.045 (s.e. 0.020), and 0.063 (s.e. 0.020).

20

Since we could not match all surnames, we use both waves for this exercise. We were able to match surnames for 33,372 observations (87.43% of the sample). Out of the unmatched 4,796 observations, 1,452 relate to Job Centers (for which we did not have a contact name) and 3,344 pertain to surnames that were present in our data but not in the Census (which reports only surnames with a frequency higher than 100).

22

For instance, in their study on almost 7,000 real estate licensees in the United States for 1999, Benjamin et al. (2007) find no significant differences in hourly wages by race. The same is true for Sirmans and Swicegood (2000), who focuses on Texas, and Sirmans and Swicegood (1997), who look at Florida.

23

In addition, exploiting the fact that half of our recipients in the second wave have already seen an email signed by a white name and the other half have received an email signed with an African-American name, we checked whether the racial difference in response rates in the second wave depends on whether the email in the first wave was signed by a black or a white name. To this end, we estimate the baseline model using only wave II, including an indicator for whether the recipient has received an email signed by a white name in wave I and its interaction with our key indicator Black. The estimate of the interaction term is very small and insignificant (0.001, s.e. 0.013), suggesting that the racial gap we estimate in wave II does not depend upon the race of sender in wave I.

24

To further probe the potential sources of statistical discrimination in our setting, we looked into the possibility that in areas with high electoral competition public officials may be more likely to worry about a “vocal voter” (as signaled by the sender’s occupation in Wave II) who is more prone to complain or communicate with politicians. Using county-level data from the 2012 presidential elections, we constructed the “effective number of parties”—an index measuring how tight election competitiveness is and that is widely employed in political sciences (see Laakso and Taagepera 1979). Adding this index to our baseline regression and interacting it with a wave II dummy, we find that the interaction is statistically insignificant, suggesting that the above-mentioned mechanism may not be a relevant driver of statistical discrimination in our case.

25

We also explored the correlation between our discrimination index and racial gaps in voting turnout. We accessed voting data by race related to the 2012 presidential elections—which are available for 34 states—and constructed a voting gap variable defined as the difference in the shares of white and black people who voted. We then regressed this variable on the discrimination index. We found a positive, albeit small and statistically insignificant correlation (0.088, s.e. 0.118). Results are nearly unchanged when adding four indicators for the U.S. regions in the regression (the estimate for the voting gap is 0.024, s.e. 0.085).

26

Alternatively, the cost may be interpreted as the penalty inflicted to the official by the supervisor in case of no response and complain by the citizen. In that case, the decision rule is to respond to queries that have a perceived cost that is above a certain threshold, that is, respond to citizens that are more likely to complain.

27

Oreopoulos (2011) applies this logic in the context of a résumé correspondence study by adding information about the candidates’ unobserved productivity and observing whether it leads to a reduction of the gap in call back rates across native and immigrant job candidates. He finds little evidence of statistical discrimination, similarly to us.

28

The assumption of a continuous treatment is not innocuous. Heckman and Siegelman (1993), Heckman (1998), and Neumark (2012) show that, when the treatment is nonlinear, as in our context, then even if there are no mean differences in unobservables between the two racial groups, differences in the variance of unobservables may give rise to differences in response due to statistical discrimination. To see this, note that the probability that a white and a black sender receives a response, assuming that X is normally distributed with mean zero, is: Φ(cw) and Φ((c − γ)/σb), where Φ denotes the standard normal distribution and σw, σb are the standard deviations for whites and blacks respectively. One can readily see that, if the standard deviations are unequal, then even in the absence of differences in mean characteristics, one can observe different probabilities of response across the two racial groups also in the absence of taste-based discrimination, that is, γ = 0.

References

Abrams
David
,
Bertrand
Marianne
,
Mullainathan
Sendhil
(
2012
).
“Do Judges Vary in Their Treatment of Race?”
Journal of Legal Studies
,
41
,
347
383
.

Alesina
Alberto
,
Ferrara
Eliana La
(
2014
).
“A Test of Racial Bias in Capital Sentencing.”
American Economic Review
,
104
(
11
),
3397
3433
.

Allport
Gordon W.
(
1954
).
The Nature of Prejudice
.
Addison
,
New York
.

Altonji
Joseph G.
,
Blank
Rebecca M.
(
1999
).
“Race and Gender in the Labor Market.”
In
Handbook of Labor Economics 3C
, edited by
Ashenfelter
O.
,
Card
D.
.
Elsevier
,
New York
, pp.
3143
3259
.

Bayer
Patrick
,
Ferreira
Fernando
,
Ross
Stephen L.
(
forthcoming
).
“What Drives Racial and Ethnic Differences in High-Cost Mortgages? The Role of High-Risk Lenders.”
Review of Financial Studies
.

Becker
Gary S.
(
1957
).
The Economics of Discrimination
.
University of Chicago Press
,
Chicago
.

Benjamin
John D.
,
Chinloy
Peter T.
,
Jud
G. Donald
,
Winkler
Daniel T.
(
2007
).
“Do Some People Work Harder than Others? Evidence from Real Estate Brokerage.”
The Journal of Real Estate Finance and Economics
,
35
,
95
110
.

Bertrand
Marianne
,
Duflo
Esther
(
2017
).
“Field Experiments on Discrimination.”
Handbook of Economic Field Experiments
,
1
,
309
393
.

Bertrand
Marianne
,
Mullainathan
Sendhil
(
2004
).
“Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination.”
American Economic Review
,
94
(
4
),
991
1013
.

Bhargava
Saurabh
,
Manoli
Dayanand
(
2015
).
“Psychological Frictions and the Incomplete Take-Up of Social Benefits: Evidence from an IRS Field Experiment.”
American Economic Review
,
105
(
11
),
3489
3529
.

Broockman
David E.
(
2013
).
“Black Politicians Are More Intrinsically Motivated to Advance Blacks’ Interests: A Field Experiment Manipulating Political Incentives.”
American Journal of Political Science
,
57
,
521
536
.

Butler
Daniel M.
,
Broockman
David E.
(
2011
).
“Do Politicians Racially Discriminate against Constituents? A Field Experiment on State Legislators.”
American Journal of Political Science
,
55
,
463
477
.

CDC
(
2011
).
“Health Disparities and Inequalities Report.”
.

Charles
Kerwin Kofi
,
Guryan
Jonathan
(
2008
).
“Prejudice and Wages: An Empirical Assessment of Becker’s The Economics of Discrimination.”
Journal of Political Economy
,
116
,
773
809
.

Charles
Kerwin Kofi
,
Guryan
Jonathan
(
2011
).
“Studying Discrimination: Fundamental Challenges and Recent Progress.”
Annual Review of Economics
,
3
,
479
511
.

Daponte
Beth Osborne
,
Sanders
Seth
,
Taylor
Lowell
(
1999
).
“Why do Low-Income Households not use Food Stamps? Evidence from an Experiment.”
Journal of Human Resources
,
34
,
612
628
.

Distelhorst
Greg
,
Hou
Yue
(
2014
).
“Ingroup Bias in Official Behavior: A National Field Experiment in China.”
Quarterly Journal of Political Science
,
9
,
203
230
.

Doleac
Jennifer L.
,
Stein
Luke C.D.
(
2013
).
“The Visible Hand: Race and Online Market Outcomes.”
Economic Journal
,
123
,
F469
F492
.

Duflo
Esther
,
Saez
Emmanuel
(
2003
).
“The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment.”
Quarterly Journal of Economics
,
118
,
815
842
.

Ewens
Michael
,
Tomlin
Bryan
,
Wang
Liang Choon
(
2014
).
“Statistical Discrimination or Prejudice? A Large Sample Field Experiment.”
Review of Economics and Statistics
,
96
,
119
134
.

Fryer
Roland G.
(
2011
).
“Racial Inequality in the 21st Century: The Declining Significance of Discrimination.”
In
Handbook of Labor Economics 4B
, edited by
Ashenfelter
O.
,
Card
D.
.
Elsevier
,
New York
, pp.
855
971
.

Fryer
Roland G.
,
Levitt
Steven D.
(
2004
).
“The Causes and Consequences of Distinctively Black Names.”
Quarterly Journal of Economics
,
119
,
767
805
.

Fryer
Roland G
,
Torelli
Paul
(
2010
).
“An Empirical Analysis of Acting White.”
Journal of Public Economics
,
94
,
380
396
.

Glaeser
Edward L.
,
Sacerdote
Bruce
(
2003
).
“Sentencing in Homicide Cases and the Role of Vengeance.”
Journal of Legal Studies
,
32
,
363
382
.

Gneezy
Uri
,
List
John
,
Price
Michael K.
(
2012
).
“Toward an Understanding of Why People Discriminate: Evidence from a Series of Natural Field Experiments.”
NBER Working Paper 17855
.
National Bureau of Economic Research
,
Cambridge, MA
.

Guryan
Jonathan
,
Charles
Kerwin Kofi
(
2013
).
“Taste-Based or Statistical Discrimination: The Economics of Discrimination Returns to its Roots.”
Economic Journal
,
123
,
F417
F432
.

Harrell
Jules P.
,
Hall
Sadiki
,
Taliaferro
James
(
2003
).
“Physiological Responses to Racism and Discrimination: An Assessment of the Evidence.”
American Journal of Public Health
,
93
,
243
248
.

Hastings
Justine S.
,
Weinstein
Jeffrey M.
(
2008
).
“Information, School Choice, and Academic Achievement: Evidence from two Experiments.”
Quarterly Journal of Economics
,
123
,
1373
1414
.

Heckman
James J.
(
1998
).
“Detecting Discrimination.”
The Journal of Economic Perspectives
,
12(2)
,
101
116
.

Heckman
James J.
,
Siegelman
Peter
(
1993
).
“The Urban Institute Audit Studies: Their Methods and Findings.”
In
Clear and Convincing Evidence: Measurement of Discrimination in America
, edited by
Fix
M.
,
Struyk
R.
.
Urban Institute Press
.

Hirschman
Albert O.
(
1970
).
Exit, Voice and Loyalty
.
Harvard University Press
,
Cambridge/Massachussets
.

Hoxby
Caroline
,
Turner
Sarah
(
2013
).
“Expanding College Opportunities for High-Achieving, Low Income Students.”
Stanford Institute for Economic Policy Research Discussion Paper 12-014
,
Stanford Institute for Economic Policy Research
,
Stanford, CA
.

Laakso
Markku
,
Taagepera
Rein
(
1979
).
““Effective” Number of Parties: A Measure with Application to West Europe.”
Comparative Political Studies
,
12
,
3
27
.

Lang
Kevin
(
2015
).
“Racial Realism: A Review Essay on John Skrentny’s After Civil Rights.”
Journal of Economic Literature
,
53
,
351
359
.

Levine
Ross
,
Rubinstein
Yona
,
Levkov
Alexey
(
2014
).
“Bank Deregulation and Racial Inequality in America.”
Critical Finance Review
,
3
,
1
48
.

Lipsky
Michael
(
1980
).
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
.
Russel Sage Foundation
,
New York
.

Neumark
David
(
2012
).
“Detecting Discrimination in Audit and Correspondence Studies.”
Journal of Human Resources
,
47
,
1128
1157
.

Neumark
David
(
2016
).
“Experimental Research on Labor Market Discrimination.”
NBER Working Paper 22022
.
National Bureau of Economic Research
,
Cambridge, MA
.

Norton
Michael I.
,
Sommers
Samuel R.
(
2011
).
“Whites See Racism as a Zero-Sum Game That They are now Losing.”
Perspectives on Psychological Science
,
6
,
215
218
.

Oreopoulos
Philip
(
2011
).
“Why do Skilled Immigrants Struggle in the Labor Market? A Field Experiment with Thirteen Thousand Résumés.”
American Economic Journal: Economic Policy
,
3
,
148
171
.

Pew Research Center
(
2013
).
How Americans Value Public Libraries in Their Community
.
Washington DC
. .

Riach
Peter A.
,
Rich
Judith
(
2002
).
“Field Experiments of Discrimination in the Market Place.”
Economic Journal
,
112
,
F480
F518
.

Rich
Judith
(
2014
).
“What do Field Experiments of Discrimination in Markets Tell us? A Meta Analysis of Studies Conducted since 2000.”
IZA Discussion Paper 8584
.
Institute for the Study of Labor
,
Bonn, Germany
.

Sabol
William J.
,
West
Heather C.
,
Cooper
Matthew
(
2009
).
“Prisoners in 2008.”
Bureau of Justice Statistics Bulletin
,
(NCJ 228417)
,
1
45
. .

Sirmans
G
,
Swicegood
Philip
(
1997
).
“Determinants of Real Estate Licensee Income.”
Journal of Real Estate Research
,
14
,
137
153
.

Sirmans
G.
,
Swicegood
Philip
(
2000
).
“Determining Real Estate Licensee Income.”
Journal of Real Estate Research
,
20
,
189
204
.

Smith
Aaron
(
2010
).
“The Internet Gives Citizens New Paths to Government Services and Information.”
Pew Research Center. http://www.pewinternet.org/2010/04/27/government-online/, retrieved 12 December 2017
.

Stephens-Davidowitz
Seth
(
2014
).
“The Cost of Racial Animus on a Black Candidate: Evidence Using Google Search Data.”
Journal of Public Economics
,
118
,
26
40
.

U.S. Government
(
2013
).
“United States Periodic Report to the Committee on Elimination of Racial Discrimination.”
.

White
Ariel R.
,
Nathan
Noah L.
,
Faller
Julie K.
(
2015
).
“What Do I Need to Vote? Bureaucratic Discretion and Discrimination by Local Election Officials.”
American Political Science Review
,
109
,
1
14
.

Wong
Gloria
,
Derthick
Annie O.
,
David
E.J.R.
,
Saw
Anne
,
Okazaki
Sumie
(
2014
).
“The What, the Why, and the How: A Review of Racial Microaggressions Research in Psychology.”
Race and Social Problems
,
6
,
181
200
.

Xu
Kaiyuan
,
Nosek
Brian
,
Greenwald
Anthony
(
2014
).
“Psychology Data from the Race Implicit Association Test on the Project Implicit Demo Website.”
Journal of Open Psychology Data
,
2
, .

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model)

Supplementary data