Abstract

This article shows how particular rule configurations can create conditions for learning from experimentation on an operation level. It does so by using the IAD framework in a diagnostic analysis of decisions to fund the development of drainage in the Denver Metropolitan Area before and after the 2013 Colorado Flood. The discussion first synthesizes recent developments in this research area. Then, it demonstrates how formal institutional analysis can be used to address existing gaps. To conclude, recommendations for further research to develop our understanding of the link between learning and change are presented.

Introduction

Floods have become a chronic and costly risk for urban inhabitants and local economies worldwide. New settlements continue to encroach on floodplains, while climate change increases the frequency of heavy rainfall. Insufficient flood control places an unprecedented amount of pressure on urban stormwater drains that are often developed at a much slower rate, but are expected to manage higher levels of runoff from impervious areas such as paved streets, parking lots and building rooftops during rainfall and snow events (United Nations, 2014). It thus seems to be in everyone’s long-term interest to maintain and develop stormwater drainage and to protect flood plains so cities can resist or at least quickly recover from heavy rainfall. Still, the immediate need for more housing and wider roads often overrules considerations for flood control. In this case, the only feasible remaining solution is to provide adequate drainage facilities that can cope with the subsequent increase in runoff. However, local stakeholders are slow to – and sometimes fail to – respond to the aforementioned threats to their communities.

The Bloomington School, under the leadership of Elinor and Vincent Ostrom, has accumulated evidence that a polycentric governance system can facilitate collective action to effectively and sustainably manage the storage and flow of water at various geographic and administrative scales (Blomquist, 2006; Heikkila, Schlager, & Davis, 2011; Ostrom, 1962, 1990). This argument is widely echoed in the literature on uncertainty, sustainability and change (Bahadur & Tanner, 2014; Béné, Cannon, Gupte, Mehta, & Tanner, 2014; Dovers & Handmer, 1992; Folke, 2006; Moench, 2014). The discussion is based on the postulate that robust and sustainable community governance is the result of learning from experimentation on the operational level, which is best realized in a polycentric setting (Ostrom, 2005b, p. 183). It is grounded onto the assumptions that any community governance system is vulnerable to threats (Ostrom, 2005b), and that particular settings can create conditions facilitating ex post learning efforts and enhance the system’s viability (Shepsle, 1989).

Yet scholars still have to specify what settings are particularly supportive of learning from experimentation at an operational level. The here presented article first synthesizes recent developments in this area. It then demonstrates how formal institutional analysis can be used to systematically describe a particular setting and the learning opportunities that it creates at the operational level. It concludes with recommendations for further research to increase our understanding of the theoretical relations between learning and change.

Learning and change in polycentric systems

The focal level of analysis of the aforementioned studies on water management is the action arena, which constitutes one of various nested arenas within a polycentric governance system (McGinnis, 2011, p. 52). It is described in terms of the seven working parts of a formal game. This includes a number of boundedly rational actors that come together to decide on an action to sustainably manage a particular resource system, the level of information about benefits and costs assigned to the action-outcome linkage and control over a negotiation process that the actors in particular positions could exercise to promote a potential outcome (Ostrom & Crawford, 2005, p. 189). Underlying this empirical work are two assumptions: a) public, private, voluntary and other types of actors from multiple administrative levels and issue domains operate within an action arena. The next assumption is that they b) operate within a jointly agreed and commonly known and used system of written and unwritten rules, including any strategies or plans that structure group behaviour. These so-called rules-in-use (‘rules’ hereafter) are described as the 'shared understanding of actors about enforced prescriptions concerning what actions (our outcomes) are required, prohibited, or permitted’ (Ostrom, 2005c, p. 18).

The Institutional Analysis Development (IAD) framework is used to illustrate the process of designing and developing rules. It recognizes that rule configurations affecting an action arena and the internal decision process within at a given time (t) might be different at time (t + 1). This means that t and t + 1 describe different state spaces (Ostrom, Cox, & Schlager, 2014). These illustrations are based on empirical studies that started to systematically investigate the composition of rules in the context of the management of common pool resources (Ostrom, 2005c; p. 18), such as water and forests (Clement, 2010; Ostrom, 1990). Theoretically, this can also entail the management of the infrastructure commons (Little, 2004) in an urban context (Foster, 2011), such as storm drainage facilities.

The dependent variable problem

It has become evident in this context that the rules, which actors agree on to govern common pool resources are not static prescriptions but on-going experiments (Cox, 2012; Villamayor-Tomas, Epstein, Evans, & Kimmich, 2015). This occurs as actors constantly learn and adapt the rules that do not conform to local conditions (Ostrom, 1990, pp. 61–69). These conditions are not durable, but change. Some change gradually over time, others change more rapidly (Cox & Ross, 2011). Actors in an action arena thus have to compensate as best they can, for predictable but also for sudden changes within their social-ecological context (Agrawal, 2003).

Shepsle (1989, p. 142) clarifies that this is an ‘ex post selection’, since actors face many uncertainties and intelligently use ‘what knowledge and information is available, but before the values of many parameters are known’. Hence, no combination of rules is an optimal fit for any particular context but constantly evolves to meet changing requirements. This ability of a governance system and/or its component parts to adapt to changing situations is often taken as an indicator of its resilience (Béné, Wood, Newsham, & Davies, 2012; Béné et al., 2014; Reid & Botterill, 2013). In some cases this involved paradigmatic rule changes, whereas in other cases rules are only moderately revised in order to clarify or strengthen their content (Ostrom, 2005b). Such moderate change can easily be missed. This can lead to false assumptions about actors’ failure to learn from their experiences as individuals (individual learning) but also as a group (collective learning), since rules are defined as the products of these two interdependent learning processes.1 This dilemma is known to scholars, who study policy learning and change, as the dependent variable problem (Howlett & Cashore, 2009).

An increasing number of IAD-based studies started to employ, test and develop the Institutional Grammar Tool (Basurto, Kingsley, McQueen, Smith, & Weible, 2010; Feiock et al., 2016; Ostrom & Basurto, 2011; Roditis, Wang, Glantz, & Fallin, 2015; Siddiki, Basurto, & Weible, 2012; Siddiki, Weible, Basurto, & Calanni, 2011) conceptualized by Crawford and Ostrom (1995, 2005). It is used to systematically describe the composition and evolution of rules that structure particular action arenas. More precisely, they use the tool to identify the working parts of particular rules: the Attribute (A), the Deontic (D), the aIm (I), the Condition (C) and the Or else (O). Attribute describes the animate agent that is to carry out a particular action. Deontic denotes the prescriptive operator specifying if an action is required, forbidden or permitted. Aim describes the action itself. Condition specifies the boundaries (spatial, temporal, procedural) in which the required action has to be performed. Or else denotes sanctions associated with the non-compliance of a prescribed action. Depending on which configuration of those working parts a rule is composed of, it is classified as a strategy, a norm or a principal rule (in the sense that it assigns a sanction to noncompliant behaviour). A strategy contains an Attribute, an aIm and a Condition (AIC); a norm contains, in addition, a Deontic (ADIC). With the addition of an Or else, the statement becomes a rule (ADICO) that either requires, permits or forbids an action (Crawford & Ostrom, 1995, p. 584). In order to decrease uncertainty among coders (p. 87), Siddiki et al. (2011) included a sixth category in each class: the receiver of the aIm (oBject). Scholars have since started to use the revised tool to detect changes with regard to the actors affected by a particular rule as well as any references to their behaviour, beneficiaries, benefits and the available sanctioning mechanisms that such a statement may or may not contain (Roditis et al., 2015; Siddiki et al., 2011, 2012; Siddiki, Carboni, Koski, & Sadiq, 2015).

This inspired Ostrom and Basurto (2011) to evaluate how a particular rule configuration has changed since its default condition (p. 330). They first distinguish principal rules from norms and strategies according to the classification proposed by Crawford and Ostrom (2005). They also take the time when these arrangements were agreed upon into consideration. Then they categorize these rules based on the elements of the action arena that they affected. Seven types of rules are distinguished in this context: rules that regulate who can enter and leave an action arena are defined as boundary rules. Position rules, in contrast, state whether there is a defined number of actors in specific positions in an action arena. Other rules influence the costs and benefits that actors assign to a particular action (payoff rules), the scope of this action (scope rules) and the way it is monitored information rules. Aggregation rules determine who decides which action or set of activities is to be undertaken. Choice rules specify what actors in specific positions must, must not, or may do at a particular point in a decision process in light of conditions that have, or have not, been met at that point of the process (Ostrom, 2005d). In short, Ostrom and Basurto (2011) outline ‘a way of conducting empirical research that records change and can then be used for rigorous testing of various theories of how change occurs’ (p. 333). When combined with a thorough analysis of the institutional grammar, this can help solving the aforementioned measurement problem in policy learning studies that focus on how rule configurations change; leaving only the question of why these arrangements change.

Factors supporting change in the dependent variable

Decisions to change a rule are ultimately based on the actor’s learning about the decision process and the effectiveness of decisions from prior situations. It is assumed that individual actors acquire, translate and disseminate information and then adapt their thoughts and behaviour to transfer their insights onto others in the collective (Ostrom et al., 2014). In this context, actors weight the expected benefits of a new rule against the benefits of the current arrangement and the costs of negotiating and implementing the new rule (Poteete et al., 2010). Here, Elinor Ostrom and her associates follow Jones (2001) and utilize primarily Gerd Gigerenzer’s definition of bounded rationality (Ostrom, 2005a, pp. 104–109); acknowledging that a rational mind evolves over time (Stanovich, 2012, pp. 345, 346). It is argued in this context that the irreducible nature of socio-ecological and economic systems manifest in uncertainty and ambiguity (Ostrom, 2005b, pp. 270, 271). More specifically, actors in an action arena face many uncertainties, such as unforeseen contingencies, unknown states of the world and incomplete information about the preferences of others. The actors thus choose their preferred action ex post following a history of experiences (Shepsle, 1989, p. 142). Personal or local experience biases their judgment about the problem at large. Hence, the available knowledge is contested. The results are power struggles and discussions between individuals who do not share a specific understanding about a given decision situation. Collective learning in an action arena is thus considered a ‘highly political affair’, since actors rarely share a common understanding of the desired outcomes (Agrawal, 2003, p. 245), nor is power equally distributed (Agrawal, 2014; Ostrom & Basurto, 2011).

Drawing on the analysis of small collective action settings, such as communal irrigation systems (Ostrom, 1990), scholars started to outline conditions that create opportunities for individual and collective learning in an action arena (Ostrom, 2005b, pp. 258–270). Eight design principles have been identified to date: Scholars established the need to clearly define a set of actors who are allowed to deduce a certain quantity of economic goods and values from a resource system at a specific time and frequency. It has also become evident that it is not sufficient to clearly define user boundaries alone. Clearly defined resource boundaries that can be enforced are as necessary. Also of importance is that the actors who are expected to obey the rules have the opportunity to engage in the prior development of these collective-choice arrangements. The evidence suggests that the arrangements have to be fair in a way that the allowed benefits of appropriating a good are relative to the costs of providing this good. Monitors and officials need to be available to detect and sanction violations of collective-choice agreements and to respond to changes in local conditions. Actors must be able to organize and have access to conflict resolution mechanisms. For these nested and complex arrangements to work, they have to concur with local conditions and have to be organized to work on multiple levels (Cox et al., 2010, p. 38).

A new generation of institutional analysis has started to investigate the applicability of these design principles to large-scale settings (Agrawal, 2014; Epstein et al., 2014; Heikkila et al., 2011; Huntjens et al., 2012; Villamayor-Tomas et al., 2014), such as special districts managing the flow and quality of water (Fleischman et al., 2014). Furthermore, this recent work has shown that two conditions in particular are crucial. First, clear resources and user boundaries help managing the use of a particular good. Secondly, monitors have to be in place to evaluate the development of the resource system and to observe whether resource users obey the agreed rules (Fleischman et al., 2014). Fleischman et al. (2014) pursued this line of inquiry further and highlight the importance of integrating not only local insights but also scientific knowledge to monitor large-scale resource use and development. Indeed, without monitoring there is no cause for sanctions and without sanctions there is little initiative to comply with the agreed rules. In large settings, this information is hardly directly accessible (Fleischman et al., 2014, p. 15). Here, actors depend on other actors to share their knowledge or to establish a bridge between the actors (Berkes, 2009). This dependency becomes visible in the development of institutional arrangements that facilitate the exchange of information (Lubell et al., 2016). Furthermore, it has become evident that not all potential sources of information are granted entry to an action arena or are recognized in their position as such, nor is information equally weighted (Berkes, 2007). Contested and ambiguous information is unlikely to mobilize sufficient support for sanctioning an actor’s noncompliance with shared agreements (Martens & van Weelden, 2014). Therefore, information has to be reliable. However, not all reliable information is accessible. This poses a challenge since only accessible information can be utilized to mobilize change (Berkes, 2007).

Much of this evidence is grounded on case studies. Only just recently have scholars started to employ methods that allow them to systematically map formal dependencies between the actors and action arenas. Siddiki et al. (2015) employed the Institutional Grammar Tool to analyse and formal dependencies outlined in various policy designs. For example, they identified the animate agent (Attribute) that is to carry out a particular action (Aim). Here, scholars measure the quality of a particular rule configuration ex ante. Heikkila et al. (2011, p. 128) argue that ‘measuring the quality of a linkage requires the linkage to be tested, or used, in practice to determine how well it works.’ Hence, they analysed the content of signed agreements with focus on the functional linkages that they create and compared the findings to the linkages reported in meeting minutes and annual reports. Combined with an analysis of the institutional grammar, this approach can help to outline evaluation criteria to assess rules designed to enhance the capacity of actors to learn in a large-scale action arena and to adapt collective choice arrangements to new challenges.

Returning to the initially mentioned problem of urban flooding, the discussion next introduces a study that employs such a combined approach to study the evolution of specific rule configurations and formal dependencies. The aim is to identify factors that supported necessary rule changes following the 2013 Colorado Flood in the United States. While prior research covering this event focused on the county level governance (Albright & Crow, 2014), this study looks at the Urban Drainage and Flood Control District; a special district that was established in 1969 to coordinate flood risk mitigation efforts in the Denver Metropolitan Region – The second most populated area in the Southwest of the United States.

Case study

The Denver Metropolitan Area recorded the costliest and deadliest of the 11 flood disasters that Colorado experienced since 1959.2 The scope and layout of the area still continues to change as it copes with a rising population. This further increases the risk of flooding, which is already high due to its foothill environment and rapid climatic changes. In other words, flooding is a predictable risk. Therefore, it is of utmost importance to local governments, businesses and inhabitants that stormwater drains are sustained over the long term. Initially though, actors in uphill counties were oblivious to the damage their actions caused in the valley. Out of this realization, a group of county engineers together with Colorado Senator Joe Shoemaker pushed for the implementation of a state statute that created the Urban Drainage and Flood Control District (‘the District’ hereafter). Their aim was to enhance the capacity of local communities to learn about the risk flood hazards inherent in the Denver Metropolitan area as a whole pose to persons and property. Additionally, they planned on adapting their efforts to coordinate, plan, construct and maintain drainage and flood control infrastructures within the region.

The District is unique in the United States as a multi-county special district established exclusively for flood hazard mitigation.3 This regional special district operates since 1969 as an independent agency, which – until today – consists only of a small number of staff as well as engineering contractors and is governed by a Board of Directors (‘the Board’ hereafter). The board members of which are appointed to represent their community (e.g. City and County of Denver). In the early days, the group established institutional mechanisms that could best allow the arena to perform its appointed duties. This includes monthly meetings where the Board decides where to conduct multi-jurisdictional flood risk assessments and master planning studies; how to prioritize the recommended measures; and how to plan the project budgets. It is authorized to impose a mill levy to finance its operations and to maintain, as well as preserve, floodways and floodplains. Though central to the relationship among local actors in the Denver Metropolitan Area, the district is only one public enterprise within a polycentric system of public and private entities engaged in flood mitigation in the South West of the United States.

Research design and data

The District has already been cited as a positive example of sustainable stormwater management in Handmer (1990) and Grigg (2011a, 2011b, Grigg, 2012), and has recently become more visible to the general public as an agent of learning in the aftermath of the 2013 Colorado flood. The case study presented here is an effort to further unpack this complex and adaptive system to better understand and learn from this example. It draws descriptive inferences about the link between rules and the District’s capacity to learn and to adapt regional drainage facilities to ecological changes from a recurring empirical situation in which actors negotiated the budget and appropriation for the year ahead. It focuses in particular on the process of planning infrastructure investments before and after the 2013 Colorado flood. Temporary/emergency solutions that were locally implemented without consultation during or immediately after the flood event are not included in the analysis. Actors participating in the Board meetings with the aim to jointly develop a sustainable drainage system for the Denver Metropolitan Area are the unit of analysis. The data for this paper was collected and analysed between September 2014 and April 2015 as part of a scoping study that will feed into a larger research project currently being developed by the author. The process involved three stages.

Data collection started with an open-ended interview with David Bennetts, leader of the District’s Design Construction Maintenance program. The one-hour interview was conducted in their headquarters on 22 September 2014. The data from this interview was used to outline the case settings and verify research findings. In a second step, two independent coders identified and analysed the content of the rules that – according to the District’s Comprehensive Annual Finance Reports (‘CAFR’ hereafter) for these years- were significant for deciding on a budget and subsequent five year plan for capital investments (‘CIP’ hereafter) in 2011, 2013 and 2014. Policies outlined in these documents4 can be defined as collective-choice rules affecting the operational level action arena (Ostrom, 2005c). These statements were analysed and classified using an approach that combined the tool presented in Ostrom and Basurto (2011) and ABDICO-based institutional analysis proposed in Siddiki et al. (2011). In a third step, the temporal sequence, structure and attributes of collective actions in relation to the capital investment planning process were mapped for each action arena and subsequently compared. The analysis focused on publicly available records of monthly Board meetings. In this context it is important to note that the analysis views collective action through the formal rules that are said to have guided activities in this context. Not included in the analysis are informal rules, which matter more in studies of weakly institutionalized contexts.

Ex ante analysis of operational level dependencies

The District’s accounting policies for 2011, 2013 and 2014 were coded sentence-by-sentence using the ABDICO scheme, and accordingly categorized into the three types of institutional statements5 (Strategies, Norms, or Rules) (Siddiki et al., 2011). The analysis identified and coded 158 statements for the year 2011, 165 for the year 2013 and 164 for the year 2014. The majority of statements were coded into strategies rather than more binding statements including a Deontic (norm) and an Or Else (principal rule). Only eight principal rules could be identified and in each case Or else was implicit in the phrases ‘by statute’ or ‘by law’. Theoretically, this can be described as a norm backed up by a metanorm (Ostrom, 2005d, p. 178).

With the exception of 14 statements, the wording of the District’s account policies for 2013 was identical to the policy statements for 2011. The data shows that the wording of three statements in total changed; for example:

Formal budgetary integration is not employed for the Project Private-Purpose Trust Fund or the Federal Grants Special Revenue Fund because effective budgetary control is achieved through specific contract agreements. (2011)

 

The District does not adopt a formal budget for the Project Private-Purpose Trust Fund or the Federal Grants Special Revenue Fund because effective budgetary control is achieved through specific contract agreements. (2013)

The coders also observed a total of eleven instances in which a statement was either added or removed. All of these statements were coded into strategies. The 2013 document introduced nine new strategies and deleted two. The changes are primarily incremental and concern the measurement (information) and order of spending (choice), but not the other elements of the action arena, for example

It is the District’s policy to use restricted amounts first, then committed, then as- signed, and then unassigned, as they are needed. (2013)

The 2011 document does not entail such a statement.

The wording in the statements in the 2013 and 2014 CAFRs are identical. Only three differences were recorded. The most significant is the number of Board members that was reduced from 23 to 22 (the City of Boulder – no longer having a population in excess of 100,000 – has one less seat on the table).

The two coders agreed that neither of these changes is likely to have an effect on the action arena. Thus, it seems fair to conclude that no paradigmatic change in the rules that could have fundamentally altered one or more characteristics of the action arena was observed at this stage of the analysis. This implies that the analysed policy design supports stable formal dependencies on the operational level. The next step is to look beyond the surface of the observed incrementalism and to investigate the link between the components of each statement (Ostrom & Basurto, 2011) as well as the aspects of the action arena in 2011, 2013 and in 2014.6

The evidence suggests that the District, the Board and other participating governmental entities (represented by individual Board members) were the key players within the action arena in 2011, 2013 and in 2014. During this period, these actors engaged in accounting and budgeting activities to plan, coordinate and justify activities associated with the District’s main function to plan, coordinate, maintain and develop drainage facilities on the operational level in the Denver Metropolitan Area.

Furthermore, for each year the statements outline the same intermediate steps that the collective needs to accomplish before the budget for the year ahead can be passed (Table 1). Following the example of Heikkila et al. (2011) joint activities are described as linkages between players in an action arena (denoted L).The first set of linkages (L1) describes all collective action taken to draft a budget. In this context, the District sent out letters to other participating governmental entities inviting them to request support for capital improvement projects. L2 describes a set of joint activities that involves the general public in the budgeting process. The overall budget (including mill levies that are ring-fenced for specific programs, i.e. Information Services and Flood Warning, Masterplanning, Floodplain Management and Design, Construction and Maintenance) and more specific capital improvement plans (CIPs) need to be presented and discussed at a public hearing. L3 describes the interactions between the District and the Board. The District maintains financial records and prepares reports for each fiscal year. The latter, as the governing body, has to authorize the budget for the year but also the spending activities. Any budgetary changes need to be authorized as well, i.e. joint projects and master planning studies. L4 describes activities in which the Board audits the District’s budgeting activities, for they, as the governing body, are then accountable to the state government (L5). Since the arrangements that outline this particular process did not noticeably change between 2011, 2013 and 2014, it can be expected that the players in each case followed the same routine when preparing and reporting the District’s budget. The data presented in the following section verifies this conclusion.

Most frequently referenced components in 2011, 2013 and 2014 policy statements.

Table 1.
Most frequently referenced components in 2011, 2013 and 2014 policy statements.
Action ArenaComponents in a Statement
AttributeaImDeonticoBjectCondition
AggregateThe DistrictResponsibleMoneysFor design, construction
BoundaryThe BoardConsists ofMembers23
ChoiceThe DistrictUseFundsFirst, second, third
InformationThe DistrictReportShouldRevenuesOnly when, on the
PositionThe DistrictMinimize risk toPerson, propertyFrom flood hazards
ScopeThe DistrictUsedShall beMill levy
PayoffThe DistrictPayMayThe costsMaintenance, construction
Action ArenaComponents in a Statement
AttributeaImDeonticoBjectCondition
AggregateThe DistrictResponsibleMoneysFor design, construction
BoundaryThe BoardConsists ofMembers23
ChoiceThe DistrictUseFundsFirst, second, third
InformationThe DistrictReportShouldRevenuesOnly when, on the
PositionThe DistrictMinimize risk toPerson, propertyFrom flood hazards
ScopeThe DistrictUsedShall beMill levy
PayoffThe DistrictPayMayThe costsMaintenance, construction
Sources: CAFR for year ending 2011 (Note1), CAFR for year ending2013 (Note 1), CAFR for year ending 2014 (Note1).
Table 1.
Most frequently referenced components in 2011, 2013 and 2014 policy statements.
Action ArenaComponents in a Statement
AttributeaImDeonticoBjectCondition
AggregateThe DistrictResponsibleMoneysFor design, construction
BoundaryThe BoardConsists ofMembers23
ChoiceThe DistrictUseFundsFirst, second, third
InformationThe DistrictReportShouldRevenuesOnly when, on the
PositionThe DistrictMinimize risk toPerson, propertyFrom flood hazards
ScopeThe DistrictUsedShall beMill levy
PayoffThe DistrictPayMayThe costsMaintenance, construction
Action ArenaComponents in a Statement
AttributeaImDeonticoBjectCondition
AggregateThe DistrictResponsibleMoneysFor design, construction
BoundaryThe BoardConsists ofMembers23
ChoiceThe DistrictUseFundsFirst, second, third
InformationThe DistrictReportShouldRevenuesOnly when, on the
PositionThe DistrictMinimize risk toPerson, propertyFrom flood hazards
ScopeThe DistrictUsedShall beMill levy
PayoffThe DistrictPayMayThe costsMaintenance, construction
Sources: CAFR for year ending 2011 (Note1), CAFR for year ending2013 (Note 1), CAFR for year ending 2014 (Note1).

Ex post analysis of operational level dependencies

We next compare the aforementioned process to the empirical situation in 2011, 2013 and 2014. Two independent coders collected the data to determine which players engaged in which joint activities at what point in time.7 The records of monthly Board meetings were reviewed in this context with a focus on joint activities that could be linked to one of the aforementioned intermediate steps in the budgeting process. To establish a link between the dynamics in the action situation and changes in the context, the activities were time stamped. In total 28 meetings were analysed

The results summarized in Tables 2, 3 demonstrate that a small group of players follows an established routine that arranges their actions related to the allocation and reporting of their fiscal resources. More specifically, the evidence in Table 2 suggests that the Board, on a monthly basis, reviews the record kept by the District’s accountant to record all financial expenditures made and revenues received by the District (L4: Cash Disbursement). The District also presents the Board almost monthly with requests to authorize studies that provide the engineering basis but also estimate the costs/ benefits of projects that are to be included in the CIP (L4: Joined Projects). The process to draft and agree the CIP for the years ahead stretches over a period of five months. Between August and September the District’s staff evaluates the project needs by sending out request letters or a CIP Draft to the local governments (L1: CIP Request Letters). This gives them the opportunity to include or change drainage improvement projects in the CIP.8 In the next meeting in September a draft of the mill levy and budget for the year ahead is presented by the executive director on behalf of the District (L1: [Year] Mill Levy [Year] Budget). In October, the Board certifies the mill levy and budget (L3: [Year] Mill Levy [Year] Budget) after it has been disseminated in a public hearing (L2: [Year] Mill Levy [Year] Budget). This hearing takes place prior to the Board meeting. After the overall budget is authorized, the draft CIP is presented to the Board in November (L1: CIP [Period]). In November or December, the Board authorizes the CIP (L3: CIP [Period]) after it has been verified at a public hearing (L2: CIP [Period]). Approximately a year later, an independent auditor evaluates the accounts. The findings are discussed with the Board (L5: [Year] Accounts) and then published (L5: CAFR[Period]). Meanwhile, the data presented in Tables 3 suggests that a small group of key players repeatedly engages in these activities in the years studied. In particular noteworthy are the District’s Executive Director (Paul Hindman) and Program Managers for Information Services and Flood Warning Program (Kevin Stewart), Masterplanning (Ken MacKenzie), Floodplain Management (David Mallory) and Design, Construction and Maintenance (David Bennetts) but also the current Board’s Executive Committee, including the Chair (Paul Lopez, Council Member, City and County of Denver), the Chair Pro Tem (Joyce Downing, Mayor, City of Northglenn), Treasurer (Heidi Williams, Mayor, City of Thornton), the Secretary (Greg Stokes, Mayor Pro Tem, City and County of Broomfield) and the Member at Large (Dave Sellards, Engineer). The latter is one of two registered engineers selected by the Board whose other members are all locally elected officials (e.g. mayor, city council member). Least engaged are the District’s administrative staff and construction managers (e.g. Jeff Fisher).

Activities reported to the Board at the monthly meetings in 2011, 2013 and 2014.

Table 2.
Activities reported to the Board at the monthly meetings in 2011, 2013 and 2014.
Key actorsThe DistrictThe PublicThe BoardThe BoardIndependent auditor
ActivitiesL1: Draft BudgetL2: Disseminate BudgetL3: Authorize BudgetL4: Internal reviewL5: Audit
Month
01 Feb 2011Cash Disbursement, Joint Projects2010 Accounts
17 Mar 2011Cash Disbursement, Joint Projects2010 Accounts
21 Apr 2011Cash Disbursement, Joint Projects
19 May 2011Cash Disbursement, Joint ProjectsCAFR 2010
16 Jun 2011Cash Disbursement, Joint Projects
18 Aug 2011CIP Request LettersCash Disbursement, Joint Projects
15 Sep 20112012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
20 Oct 20112012 Mill Levy, 2012 Budget2012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
17 Nov 2011CIP 2011–2015Cash Disbursement, Joint Projects
15 Dec 2011CIP 2011–2015CIP 2011–2015Cash Disbursement, Joint Projects
01 Feb 2013Cash Disbursement, Joint Projects2012 Accounts
21 Mar 2013Cash Disbursement, Joint Projects2012 Accounts
18 Apr 2013Cash Disbursement, Joint Projects
16 May 2013Cash Disbursement, Joint ProjectsCAFR 2012
15 Aug 2013CIP Request LettersCash Disbursement, Joint Projects
19 Sep 20132014 Mill Levy, 2014 Budget, *CIP Request LettersCash Disbursement, Joint Projects
17 Oct 20132014 Mill Levy, 2014 Budget2014 Mill Levy, 2014 BudgetCash Disbursement, Joint Projects
21 Nov 2013CIP 2013–2017Cash Disbursement, Joint Projects
19 Dec 2013CIP 2013–2017CIP 2013–2017Cash Disbursement, Joint Projects
03 Feb 2014Cash Disbursement, Joint Projects2013 Accounts
20 Mar 2014Cash Disbursement, Joint Projects2013 Accounts
17 Apr 2014Cash Disbursement, Joint ProjectsCAFR 2013
15 May 2014Cash Disbursement, Joint Projects
21 Aug 2014CIP Request LettersCash Disbursement, Joint Projects
18 Sep 20142015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
16 Oct 2014CIP 2014–20182015 Mill Levy, 2015 Budget2015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
20 Nov 2014CIP 2014–2018CIP 2014–2018Cash Disbursement, Joint Projects
18 Dec 2014Cash Disbursement, Joint Projects
Key actorsThe DistrictThe PublicThe BoardThe BoardIndependent auditor
ActivitiesL1: Draft BudgetL2: Disseminate BudgetL3: Authorize BudgetL4: Internal reviewL5: Audit
Month
01 Feb 2011Cash Disbursement, Joint Projects2010 Accounts
17 Mar 2011Cash Disbursement, Joint Projects2010 Accounts
21 Apr 2011Cash Disbursement, Joint Projects
19 May 2011Cash Disbursement, Joint ProjectsCAFR 2010
16 Jun 2011Cash Disbursement, Joint Projects
18 Aug 2011CIP Request LettersCash Disbursement, Joint Projects
15 Sep 20112012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
20 Oct 20112012 Mill Levy, 2012 Budget2012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
17 Nov 2011CIP 2011–2015Cash Disbursement, Joint Projects
15 Dec 2011CIP 2011–2015CIP 2011–2015Cash Disbursement, Joint Projects
01 Feb 2013Cash Disbursement, Joint Projects2012 Accounts
21 Mar 2013Cash Disbursement, Joint Projects2012 Accounts
18 Apr 2013Cash Disbursement, Joint Projects
16 May 2013Cash Disbursement, Joint ProjectsCAFR 2012
15 Aug 2013CIP Request LettersCash Disbursement, Joint Projects
19 Sep 20132014 Mill Levy, 2014 Budget, *CIP Request LettersCash Disbursement, Joint Projects
17 Oct 20132014 Mill Levy, 2014 Budget2014 Mill Levy, 2014 BudgetCash Disbursement, Joint Projects
21 Nov 2013CIP 2013–2017Cash Disbursement, Joint Projects
19 Dec 2013CIP 2013–2017CIP 2013–2017Cash Disbursement, Joint Projects
03 Feb 2014Cash Disbursement, Joint Projects2013 Accounts
20 Mar 2014Cash Disbursement, Joint Projects2013 Accounts
17 Apr 2014Cash Disbursement, Joint ProjectsCAFR 2013
15 May 2014Cash Disbursement, Joint Projects
21 Aug 2014CIP Request LettersCash Disbursement, Joint Projects
18 Sep 20142015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
16 Oct 2014CIP 2014–20182015 Mill Levy, 2015 Budget2015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
20 Nov 2014CIP 2014–2018CIP 2014–2018Cash Disbursement, Joint Projects
18 Dec 2014Cash Disbursement, Joint Projects
Source: UDFCD website (past board meetings).
Table 2.
Activities reported to the Board at the monthly meetings in 2011, 2013 and 2014.
Key actorsThe DistrictThe PublicThe BoardThe BoardIndependent auditor
ActivitiesL1: Draft BudgetL2: Disseminate BudgetL3: Authorize BudgetL4: Internal reviewL5: Audit
Month
01 Feb 2011Cash Disbursement, Joint Projects2010 Accounts
17 Mar 2011Cash Disbursement, Joint Projects2010 Accounts
21 Apr 2011Cash Disbursement, Joint Projects
19 May 2011Cash Disbursement, Joint ProjectsCAFR 2010
16 Jun 2011Cash Disbursement, Joint Projects
18 Aug 2011CIP Request LettersCash Disbursement, Joint Projects
15 Sep 20112012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
20 Oct 20112012 Mill Levy, 2012 Budget2012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
17 Nov 2011CIP 2011–2015Cash Disbursement, Joint Projects
15 Dec 2011CIP 2011–2015CIP 2011–2015Cash Disbursement, Joint Projects
01 Feb 2013Cash Disbursement, Joint Projects2012 Accounts
21 Mar 2013Cash Disbursement, Joint Projects2012 Accounts
18 Apr 2013Cash Disbursement, Joint Projects
16 May 2013Cash Disbursement, Joint ProjectsCAFR 2012
15 Aug 2013CIP Request LettersCash Disbursement, Joint Projects
19 Sep 20132014 Mill Levy, 2014 Budget, *CIP Request LettersCash Disbursement, Joint Projects
17 Oct 20132014 Mill Levy, 2014 Budget2014 Mill Levy, 2014 BudgetCash Disbursement, Joint Projects
21 Nov 2013CIP 2013–2017Cash Disbursement, Joint Projects
19 Dec 2013CIP 2013–2017CIP 2013–2017Cash Disbursement, Joint Projects
03 Feb 2014Cash Disbursement, Joint Projects2013 Accounts
20 Mar 2014Cash Disbursement, Joint Projects2013 Accounts
17 Apr 2014Cash Disbursement, Joint ProjectsCAFR 2013
15 May 2014Cash Disbursement, Joint Projects
21 Aug 2014CIP Request LettersCash Disbursement, Joint Projects
18 Sep 20142015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
16 Oct 2014CIP 2014–20182015 Mill Levy, 2015 Budget2015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
20 Nov 2014CIP 2014–2018CIP 2014–2018Cash Disbursement, Joint Projects
18 Dec 2014Cash Disbursement, Joint Projects
Key actorsThe DistrictThe PublicThe BoardThe BoardIndependent auditor
ActivitiesL1: Draft BudgetL2: Disseminate BudgetL3: Authorize BudgetL4: Internal reviewL5: Audit
Month
01 Feb 2011Cash Disbursement, Joint Projects2010 Accounts
17 Mar 2011Cash Disbursement, Joint Projects2010 Accounts
21 Apr 2011Cash Disbursement, Joint Projects
19 May 2011Cash Disbursement, Joint ProjectsCAFR 2010
16 Jun 2011Cash Disbursement, Joint Projects
18 Aug 2011CIP Request LettersCash Disbursement, Joint Projects
15 Sep 20112012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
20 Oct 20112012 Mill Levy, 2012 Budget2012 Mill Levy, 2012 BudgetCash Disbursement, Joint Projects
17 Nov 2011CIP 2011–2015Cash Disbursement, Joint Projects
15 Dec 2011CIP 2011–2015CIP 2011–2015Cash Disbursement, Joint Projects
01 Feb 2013Cash Disbursement, Joint Projects2012 Accounts
21 Mar 2013Cash Disbursement, Joint Projects2012 Accounts
18 Apr 2013Cash Disbursement, Joint Projects
16 May 2013Cash Disbursement, Joint ProjectsCAFR 2012
15 Aug 2013CIP Request LettersCash Disbursement, Joint Projects
19 Sep 20132014 Mill Levy, 2014 Budget, *CIP Request LettersCash Disbursement, Joint Projects
17 Oct 20132014 Mill Levy, 2014 Budget2014 Mill Levy, 2014 BudgetCash Disbursement, Joint Projects
21 Nov 2013CIP 2013–2017Cash Disbursement, Joint Projects
19 Dec 2013CIP 2013–2017CIP 2013–2017Cash Disbursement, Joint Projects
03 Feb 2014Cash Disbursement, Joint Projects2013 Accounts
20 Mar 2014Cash Disbursement, Joint Projects2013 Accounts
17 Apr 2014Cash Disbursement, Joint ProjectsCAFR 2013
15 May 2014Cash Disbursement, Joint Projects
21 Aug 2014CIP Request LettersCash Disbursement, Joint Projects
18 Sep 20142015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
16 Oct 2014CIP 2014–20182015 Mill Levy, 2015 Budget2015 Mill Levy, 2015 BudgetCash Disbursement, Joint Projects
20 Nov 2014CIP 2014–2018CIP 2014–2018Cash Disbursement, Joint Projects
18 Dec 2014Cash Disbursement, Joint Projects
Source: UDFCD website (past board meetings).

Board meetings in 2011, 2013 and 2014: Board Members.

Table 3.
Board meetings in 2011, 2013 and 2014: Board Members.
Year201120132014
Participating entityNumber of meetings1099
The Board*Adams CountyAlice Nichol800
Charles Tedesco077
Arapahoe CountySusan Beckman800
Nancy Sharpe086
City of AvadaBob Dyer800
Mark Goff028
Ken Lucas001
City of AuroraRachel Zenzinger170
Barbara Cleland100
Marsha Berzin080
Renie Peterson900
Bob Roth019
Bob Murphy007
Boulder CountyCindy Domenico100
Deb Gardner033
City of BoulderLisa Morzel266
Ken Wilson700
George Karakegian005
City/ County of BroomfieldWalt Spader700
Greg Stokes188
City of CentennialVorry Moon700
Stephanie Piko080
City/ County of DenverCary Kennedy242
Paul Lopez468
Peggy Lehman775
Mary Beth Susman175
Marcia Johnson300
Bill Vidal100
Douglas CountyJill Repella442
City of EdgewaterBonnie McNulty989
Jefferson CountyFaye Griffin888
City of LakewoodBob Murphy754
City of LittletonDoug Clark700
Debbie Brinkman050
Bruce Beckman007
City of NorthglennJoyce Downing877
Town of SuperiorAndrew Muckle710
City of ThorntonHeidi Williams297
Mack Goodman600
City of WestminsterNancy McNally970
Herb Atchison007
Consulting EngineerMark Hunter069
Consulting EngineerBob Hoffmaster900
Consulting EngineerDave Sellards1088
The DistrictUDFCDAmelia Deleon099
UDFCDBarbara Chongtoua (6)675
UDFCDBill DeGroot (8)831
UDFCDBryan Kohlenberg (3)377
UDFCDDave Bennetts (10)1069
UDFCDDavid Mallory (8)868
UDFCDDavid Skuodas (10)1056
UDFCDEd Krisor (10)1099
UDFCDFrank Dobbins (6)670
UDFCDGeanesia Hinton (3)300
UDFCDHolly Piza (9)978
UDFCDJoanna Czarnecka (1 )145
UDFCDJulia Bailey (1)199
UDFCDKen MacKenzie (9)998
UDFCDKevin Stewart (8)859
UDFCDLaura Kroeger (9)976
UDFCDMargaret Corkery (3)300
UDFCDPaul Hindman (10)1099
UDFCDRichard Borchardt (10)1089
UDFCDSandra Gonzalez (9)900
UDFCDShea Thomas (10)1059
UDFCDTeresa Patterson008
UDFCDTerry Fead (8)899
UDFCDTerri Schaffer003
UDFCDJeff Fisher (1)110
UDFCDDarla Reeves (1)100
UDFCDMike Sarmento (1)100
UDFCDDarren Bradshaw (1)100
UDFCDWanda Salazar010
Year201120132014
Participating entityNumber of meetings1099
The Board*Adams CountyAlice Nichol800
Charles Tedesco077
Arapahoe CountySusan Beckman800
Nancy Sharpe086
City of AvadaBob Dyer800
Mark Goff028
Ken Lucas001
City of AuroraRachel Zenzinger170
Barbara Cleland100
Marsha Berzin080
Renie Peterson900
Bob Roth019
Bob Murphy007
Boulder CountyCindy Domenico100
Deb Gardner033
City of BoulderLisa Morzel266
Ken Wilson700
George Karakegian005
City/ County of BroomfieldWalt Spader700
Greg Stokes188
City of CentennialVorry Moon700
Stephanie Piko080
City/ County of DenverCary Kennedy242
Paul Lopez468
Peggy Lehman775
Mary Beth Susman175
Marcia Johnson300
Bill Vidal100
Douglas CountyJill Repella442
City of EdgewaterBonnie McNulty989
Jefferson CountyFaye Griffin888
City of LakewoodBob Murphy754
City of LittletonDoug Clark700
Debbie Brinkman050
Bruce Beckman007
City of NorthglennJoyce Downing877
Town of SuperiorAndrew Muckle710
City of ThorntonHeidi Williams297
Mack Goodman600
City of WestminsterNancy McNally970
Herb Atchison007
Consulting EngineerMark Hunter069
Consulting EngineerBob Hoffmaster900
Consulting EngineerDave Sellards1088
The DistrictUDFCDAmelia Deleon099
UDFCDBarbara Chongtoua (6)675
UDFCDBill DeGroot (8)831
UDFCDBryan Kohlenberg (3)377
UDFCDDave Bennetts (10)1069
UDFCDDavid Mallory (8)868
UDFCDDavid Skuodas (10)1056
UDFCDEd Krisor (10)1099
UDFCDFrank Dobbins (6)670
UDFCDGeanesia Hinton (3)300
UDFCDHolly Piza (9)978
UDFCDJoanna Czarnecka (1 )145
UDFCDJulia Bailey (1)199
UDFCDKen MacKenzie (9)998
UDFCDKevin Stewart (8)859
UDFCDLaura Kroeger (9)976
UDFCDMargaret Corkery (3)300
UDFCDPaul Hindman (10)1099
UDFCDRichard Borchardt (10)1089
UDFCDSandra Gonzalez (9)900
UDFCDShea Thomas (10)1059
UDFCDTeresa Patterson008
UDFCDTerry Fead (8)899
UDFCDTerri Schaffer003
UDFCDJeff Fisher (1)110
UDFCDDarla Reeves (1)100
UDFCDMike Sarmento (1)100
UDFCDDarren Bradshaw (1)100
UDFCDWanda Salazar010
Source: UDFCD website (past board meetings).

* This includes: Mayor or Deputy Mayor of the City and County of Denver as ex officio director; three Denver council members appointed by the City Council; one commissioner from each of the counties of Adams, Arapahoe, Boulder, Jefferson, and Douglas appointed by their respective Board of County Commissioners; one Mayor from each of the counties of Adams, Arapahoe, Boulder, and Jefferson appointed by the Governor; Mayor or Mayor Pro Tem from the City and County of Broomfield; Mayor or Mayor Pro Tem of any City having population in excess of 100,000 as ex officio member (currently six, Aurora, Arvada, Centennial, Lakewood, Thornton and Westminster); and two licensed professional engineers appointed by the Board of Directors).

Table 3.
Board meetings in 2011, 2013 and 2014: Board Members.
Year201120132014
Participating entityNumber of meetings1099
The Board*Adams CountyAlice Nichol800
Charles Tedesco077
Arapahoe CountySusan Beckman800
Nancy Sharpe086
City of AvadaBob Dyer800
Mark Goff028
Ken Lucas001
City of AuroraRachel Zenzinger170
Barbara Cleland100
Marsha Berzin080
Renie Peterson900
Bob Roth019
Bob Murphy007
Boulder CountyCindy Domenico100
Deb Gardner033
City of BoulderLisa Morzel266
Ken Wilson700
George Karakegian005
City/ County of BroomfieldWalt Spader700
Greg Stokes188
City of CentennialVorry Moon700
Stephanie Piko080
City/ County of DenverCary Kennedy242
Paul Lopez468
Peggy Lehman775
Mary Beth Susman175
Marcia Johnson300
Bill Vidal100
Douglas CountyJill Repella442
City of EdgewaterBonnie McNulty989
Jefferson CountyFaye Griffin888
City of LakewoodBob Murphy754
City of LittletonDoug Clark700
Debbie Brinkman050
Bruce Beckman007
City of NorthglennJoyce Downing877
Town of SuperiorAndrew Muckle710
City of ThorntonHeidi Williams297
Mack Goodman600
City of WestminsterNancy McNally970
Herb Atchison007
Consulting EngineerMark Hunter069
Consulting EngineerBob Hoffmaster900
Consulting EngineerDave Sellards1088
The DistrictUDFCDAmelia Deleon099
UDFCDBarbara Chongtoua (6)675
UDFCDBill DeGroot (8)831
UDFCDBryan Kohlenberg (3)377
UDFCDDave Bennetts (10)1069
UDFCDDavid Mallory (8)868
UDFCDDavid Skuodas (10)1056
UDFCDEd Krisor (10)1099
UDFCDFrank Dobbins (6)670
UDFCDGeanesia Hinton (3)300
UDFCDHolly Piza (9)978
UDFCDJoanna Czarnecka (1 )145
UDFCDJulia Bailey (1)199
UDFCDKen MacKenzie (9)998
UDFCDKevin Stewart (8)859
UDFCDLaura Kroeger (9)976
UDFCDMargaret Corkery (3)300
UDFCDPaul Hindman (10)1099
UDFCDRichard Borchardt (10)1089
UDFCDSandra Gonzalez (9)900
UDFCDShea Thomas (10)1059
UDFCDTeresa Patterson008
UDFCDTerry Fead (8)899
UDFCDTerri Schaffer003
UDFCDJeff Fisher (1)110
UDFCDDarla Reeves (1)100
UDFCDMike Sarmento (1)100
UDFCDDarren Bradshaw (1)100
UDFCDWanda Salazar010
Year201120132014
Participating entityNumber of meetings1099
The Board*Adams CountyAlice Nichol800
Charles Tedesco077
Arapahoe CountySusan Beckman800
Nancy Sharpe086
City of AvadaBob Dyer800
Mark Goff028
Ken Lucas001
City of AuroraRachel Zenzinger170
Barbara Cleland100
Marsha Berzin080
Renie Peterson900
Bob Roth019
Bob Murphy007
Boulder CountyCindy Domenico100
Deb Gardner033
City of BoulderLisa Morzel266
Ken Wilson700
George Karakegian005
City/ County of BroomfieldWalt Spader700
Greg Stokes188
City of CentennialVorry Moon700
Stephanie Piko080
City/ County of DenverCary Kennedy242
Paul Lopez468
Peggy Lehman775
Mary Beth Susman175
Marcia Johnson300
Bill Vidal100
Douglas CountyJill Repella442
City of EdgewaterBonnie McNulty989
Jefferson CountyFaye Griffin888
City of LakewoodBob Murphy754
City of LittletonDoug Clark700
Debbie Brinkman050
Bruce Beckman007
City of NorthglennJoyce Downing877
Town of SuperiorAndrew Muckle710
City of ThorntonHeidi Williams297
Mack Goodman600
City of WestminsterNancy McNally970
Herb Atchison007
Consulting EngineerMark Hunter069
Consulting EngineerBob Hoffmaster900
Consulting EngineerDave Sellards1088
The DistrictUDFCDAmelia Deleon099
UDFCDBarbara Chongtoua (6)675
UDFCDBill DeGroot (8)831
UDFCDBryan Kohlenberg (3)377
UDFCDDave Bennetts (10)1069
UDFCDDavid Mallory (8)868
UDFCDDavid Skuodas (10)1056
UDFCDEd Krisor (10)1099
UDFCDFrank Dobbins (6)670
UDFCDGeanesia Hinton (3)300
UDFCDHolly Piza (9)978
UDFCDJoanna Czarnecka (1 )145
UDFCDJulia Bailey (1)199
UDFCDKen MacKenzie (9)998
UDFCDKevin Stewart (8)859
UDFCDLaura Kroeger (9)976
UDFCDMargaret Corkery (3)300
UDFCDPaul Hindman (10)1099
UDFCDRichard Borchardt (10)1089
UDFCDSandra Gonzalez (9)900
UDFCDShea Thomas (10)1059
UDFCDTeresa Patterson008
UDFCDTerry Fead (8)899
UDFCDTerri Schaffer003
UDFCDJeff Fisher (1)110
UDFCDDarla Reeves (1)100
UDFCDMike Sarmento (1)100
UDFCDDarren Bradshaw (1)100
UDFCDWanda Salazar010
Source: UDFCD website (past board meetings).

* This includes: Mayor or Deputy Mayor of the City and County of Denver as ex officio director; three Denver council members appointed by the City Council; one commissioner from each of the counties of Adams, Arapahoe, Boulder, Jefferson, and Douglas appointed by their respective Board of County Commissioners; one Mayor from each of the counties of Adams, Arapahoe, Boulder, and Jefferson appointed by the Governor; Mayor or Mayor Pro Tem from the City and County of Broomfield; Mayor or Mayor Pro Tem of any City having population in excess of 100,000 as ex officio member (currently six, Aurora, Arvada, Centennial, Lakewood, Thornton and Westminster); and two licensed professional engineers appointed by the Board of Directors).

This data is indicative of sustained information exchange between engineering experts, actors that understand local development needs and solutions and actors with the knowledge and skills to facilitate the development of an integrated stormwater management system. Furthermore, it suggests that this group follows an established routine to draft, disseminate, authorize the budget and the subsequent CIP as well as report spending activities. This routine seems to have evolved around specific Conditions embedded in the analysed statements, e.g.

In the fall of each year [Condition], the District’s Board of Directors holds public hearings... (CAFRs 2011, 2013, 2014).

Here, the rule outlines not only the activities and the actors expected to engage in them, but also defines a timeframe.

Observed learning and change at the operational level

These observations suggest that the action arenas in 2011, 2013 and 2014 were grounded in a set of rules (primarily strategies) that facilitated communication and reciprocity between a small number of locally elected officials and senior District staff who drafted and authorized the District’s plans for capital improvements. This evidence complements prior research highlighting the District’s modest size and its cordial rapport with general purpose governments as essential factors to explain why the group is able to sustainably manage different perspectives on the risk of flooding in the Denver Metropolitan Area as well as on the benefits and costs of potential mitigation measures (Grigg, 2011a, 2011b, 2012; Handmer, 1990). Theoretically, collective action is particularly successful where a homogenous group of players engages in continued interaction to sustain a clearly defined resource system (Cox et al., 2010; Fleischman et al., 2014). According to Agrawal (2014), communication, reciprocity and trust are the only conditions by which collective learning and collective action can be achieved in response to endogenous and exogenous changes (Agrawal, 2014). Thus, it seems fair to assume that the observed players operated under conditions favourable for learning and adaptation when confronted with shifting resource needs after the September 2013 flooding event.

The minutes of the four Board meetings that took place between the flood in September and the adoption of the next CIP in December 2013 support this conclusion. The records mention that the fiscal resources funding infrastructure developments were limited and in order to add a new project, another project had to be omitted or postponed. Although the Board ultimately authorized the list of projects to which priority should be given in December 2013 (see Table 2, L3 ‘CIP 2013–2017’), the plan itself was the outcome of a consultation process that involved the District and all other participating governmental entities. First, the District issued a call for funding applications a few weeks before the draft budget and mill levy for the coming fiscal year was presented in the September Board meeting (see Table 2, L1 ‘2014 Budget and 2014 Mill Levy’). As the area experienced heavy rain and catastrophic flooding between the 9th and 15th of September 2013, the District decided to resend their request for calls and initiated another consultation that took flood-related changes into account (see Table 2, L1 ‘*CIP Request Letters’). The record of the September 2013 meeting shows that the District diverted from the established routine in 2013 only in so far as to initiate a second round of CIP requests to accommodate and/or prioritize flood related projects in the CIP (UDFCD 21 Nov 2013):

The District has worked closely with local governments to incorporate priority projects in the CIP, including incorporating follow-up requests that were submitted as a result of the 2013 flood. These draft plans will be sent out to our local government contacts for their review and comment.

According to David Bennetts, central to the discussion with the other participating governmental entities to prioritize projects are the planning studies that are carried out to estimate the hazard and costs of the measures to mitigate the risk. The records of the Board meetings suggest that these planning studies are managed by highly specialized contractors and consultants in collaboration with the District, affected government entities, local inhabitants and businesses that reside in the study area. The Board ultimately authorizes the research but also disseminates the final report. In other words, every other participating governmental entity could apply for funding support, but only projects for which planning studies have been concluded were considered. Although the consultation itself is not captured in the records of Board meetings, one can assume that any conflict at this stage would have surfaced in December when the District presented the agreed plan at the public hearing and to the Board for scrutiny and approval. No such conflict was recorded in the 2013 or 2014 meeting minutes, suggesting that all players arrived at a shared understanding of what projects should be prioritized to receive funding support within the time period available to them. This suggests that the conditions were indeed favourable for learning and adaptation in the context of rapid ecological changes.

To sum up, although this discussion extends the study of collective action to an urban commons context (Blomquist & deLeon, 2011; Foster, 2011), the focus of the article is on collective choice-level rule configurations and the opportunities that they generate for learning in an operational level action arena where players constantly adapt their plans to fund the development of drainage facilities in the Denver Metropolitan Area. The evidence presented in this section adds weight to the conclusion that in 2011, 2013 and 2014 these actors operated under conditions that the Bloomington School highlights as supportive of learning and adaptation in small collective action settings but also large-scale settings (Cox et al., 2010; Fleischman et al., 2014; Villamayor-Tomas et al., 2014). First, rules were in place to ensure that the process of drafting the budget and subsequent CIP was transparent and accessible to all parties. The setting supported a monitoring system involving local players but also independent expert auditors. Second, the existing rules facilitated communication and reciprocity between all the players in the action arena. Third, the rules clearly outlined the actors engaging in the action arena. This group of players was small. Fourth, the rules clearly focused on activities with the goal to develop drainage facilities to mitigate flood risk in the Denver Metropolitan Area. Finally, the rules also maintain a system of checks and balances ensuring that each player can be held accountable for his or her actions. The rules defining these conditions have remained constant between 2011 and 2014, supporting reciprocity. Furthermore, the fact that the vast majority of these statements was worded into strategies rather than binding norms and principal rules implies high levels of trust between the players (Ostrom, 2005a). This assumption, although supported by Grigg (2012) and Handmer (1990), has yet to be verified.

Research gaps and recommendations for further research

The present diagnostic study is explorative in the sense that it tests the usefulness of an approach introduced by Ostrom and Basurto (2011), modified by Siddiki et al. (2011) studying the configurational character of particular rules over time and with regard to the elements of the action arena that they affect. It describes the rule configuration that structures the actions and outcomes of the operational level action arena. This negotiates the distribution of resources to fund the development of drainage facilities in the Denver Metropolitan Area in 2011, 2013 and 2014 in an effort to mitigate the predictable risk of flooding. The IAD framework is used to guide this research. The analysis focuses particularly on rules that structured the conditions supportive of learning and adaptation in response to the 2013 Colorado flood. In this context, change is defined as the product of hidden learning processes (Heikkila & Gerlak, 2013). At the same time it elicits assumptions about the cognitive process itself. The study found that the actors in this operational level action arena were able to quickly respond to the 2013 Colorado Flood, due to the institutional design creating high levels of trust and reciprocity. According to Ostrom (2005b, p. 272), conditions that undermine mutual trust and reciprocity threaten robust and sustainable community governance.

The analysis falls into the category of contemporary studies of policy learning and change (Capano & Howlett, 2009; Dunlop & Radaelli, 2013; Howlett & Cashore, 2009; Knill et al., 2011). It acknowledges that policies are the result of policy experiments (Radaelli, 1995; Wildavsky, 1979) trying to improve the fit between rules and decision processes as well as as the fit between rules and the social-ecological context (Epstein et al., 2015).

The findings are case specific and only describe the action arena before the 2013 Colorado flood (2011), the year in which the flood occurred (2013) and the year after (2014). In future research, the method tested in this case study can and should be used to study the evolution of rules from the origin of this action arena and in relation to prior floods in the region. Prior studies have already outlined the use of studying the evolution of public spending plans in a systematic way over time. Most of these studies cover several decades. For example, research analysing the evolution of budgeting data at the federal level in the United States showed that long periods of incrementalism are only occasionally punctured by a short period of major change (Baumgartner & Bonafont, 2015; Berry, 1990; True, 2000). The action arenas that have been described in this study seem to fall in a period of incrementalism, since the configurations of the analysed rules fall under what would best be described as first order change (Hall, 1993). The research design tested in this study seems to be suitable to complement current approaches that have been used to detect and monitor incremental changes over time. It can thus help to address the dependent variable problem (Howlett & Cashore, 2009).

While a longitudinal study is one possible line along which this research can be further developed, another is to explore the links between multiple interrelated action arenas. For example, a potential step forward in this direction could be research integrating the present analysis of the capital investment planning process with evidence about the master planning process that provides expert information on the costs and benefits of drainage investments. At this point, there is potential to utilize the findings by Albright and Crow (2014), who analysed obstacles to local stakeholder’s participation in flood risk mitigation at the local level. Follow-up research can also look beyond formalized dependencies and directly ask actors about their collaborators (Ingold, 2014). This way, previous research identified brokers, actors with the opportunity to facilitate learning between two otherwise disconnected action arenas.

On a more general note, it may very well be that we are no closer to measuring and understanding the hidden learning process (Biegelbauer, 2007a, 2007b; James & Lodge, 2003). However, this does not mean that we cannot study the link between learning and change in polycentric governance systems. In fact, Howlett and Cashore (2009, pp. 34, 35) outlined the advantages of longitudinal research on the effects of institutional change on policy-making. The present discussion highlights an innovative approach to detect and monitor particular rule configurations in relation to the structure of an action arena. It is well integrated within the IAD framework, which simplifies the process of developing it further. To put in a nutshell, there is an availability of tools to systematically measure the evolution of rule configurations and formal dependencies, and to relate these observations to evidence about changes in the conditions under which actors in a particular action arena learn and adapt to endogenous and exogenous changes. The next step is to aggregate sufficient data to develop theoretical arguments with regard to the conditions supportive of learning at an operational level.

Disclosure statement

No potential conflict of interest was reported by the author.

Antje Witting is a Postdoctoral Research Fellow. Her current research explores individual and collective decision-making in the context of urban policy development, with particular focus on the measurement of policy learning.

References

Agrawal
,
A.
(
2003
).
Sustainable governance of common – Pool resources: Context, methods, and politics
.
Annual Review of Anthropology
,
32
,
243
262
.

Agrawal
,
A.
(
2014
).
Studying the commons, governing common – Pool resource outcomes: Some concluding thoughts
.
Environmental Science and Policy
,
36
,
86
91
.

Albright
,
E. A
., &
Crow
,
D. A
. (
2014
).
Learning processes, public and stakeholder engagement: Analyzing responses to colorado’s extreme flood events of 2013
(
1
29
),
Washington, DC
:
American Political Science Association.

Bahadur
,
A
., &
Tanner
,
T.
(
2014
).
Transformational resilience thinking: Putting people, power and politics at the heart of urban climate resilience
.
Environment and Urbanization
,
26
,
200
214
.

Basurto
,
X.
,
Kingsley
,
G.
,
McQueen
,
K.
,
Smith
,
M.
, &
Weible
,
C. M.
(
2010
).
A systematic approach to institutional analysis: Applying Crawford and Ostrom’s grammar
.
Political Research Quarterly
,
63
,
523
537
.

Baumgartner
,
F. R
., &
Bonafont
,
L. C
. (
2015
).
All news is bad news: Newspaper coverage of political parties in Spain
.
Political Communication
,
32
,
268
291
.

Béné
,
C
.,
Cannon
,
T
.,
Gupte
,
J
.,
Mehta
,
L
., &
Tanner
,
T
. (
2014
).
Exploring the potential and limits of the resilience agenda in rapidly urbanising contexts
.
Technical Report 63
.
Brighton
:
Institute of Development Studies.

Béné
,
C
.,
Wood,
 
R. G
.,
Newsham
,
A.
, &
Davies
,
M
. (
2012
).
Resilience: New Utopia or New Tyranny? Reflection about the potentials and limits of the concept of resilience in relation to vulnerability reduction programmes
. Working Paper 405.
Institute of Development Studies
,
Brighton
.

Berkes
,
F.
(
2007
).
Understanding uncertainty and reducing vulnerability: Lessons from resilience thinking
.
Natural Hazards
,
41
,
283
295
.

Berkes
,
F.
(
2009
).
Evolution of co-management: Role of knowledge generation, bridging organizations and social learning
.
Journal of Environmental Management
,
90
,
1692
1702
.

Berry
,
W. D.
(
1990
).
The confusing case of budgetary incrementalism: Too many meanings for a single concept
.
The Journal of Politics
,
52
,
167
196
.

Biegelbauer
,
P.
(
2007a
).
A new perspective on political action: Policy-learning approaches in comparison
.
Osterreichische Zeitschrift Fur Politikwissenschaft
,
36
,
231
.

Biegelbauer
,
P
. (
2007b
).
Ein neuer Blick auf politisches Handeln: Politik-Lernansätze im Vergleich
.
Österreichische Zeitschrift für Politikwissenschaft
,
36
,
231
247
.

Blomquist
,
W
. (
2006
). Crafting water constitutions in California. In
F.
 
Sabetti
,
B.
 
Allen
, &
M.
 
Sproule-Jones
(Eds.),
The practice of constitutional development: Vincent Ostrom’s quest to understand human affairs
(Chap. 6, 1st ed., pp.
99
134
).
Boulder, CO
:
Lexington Books
.

Blomquist
,
W.
, &
deLeon
,
P.
(
2011
).
The design and promise of the institutional analysis and development framework
.
Policy Studies Journal
,
39
(
1
),
1
6
.

Capano
,
G.,
&
Howlett
,
M.
(
2009
).
Introduction: The determinants of policy change: Advancing the debate
.
Journal of Comparative Policy Analysis: Research and Practice
,
11
(
1
),
1
5
.

Clement
,
F.
(
2010
).
Analysing decentralised natural resource governance: Proposition for a “politicised” institutional analysis and development framework
.
Policy Sciences
,
43
,
129
156
.

Cox
,
M.
(
2012
).
Diagnosing institutional fit: A formal perspective
.
Ecology and Society
,
17
,
54
63
.

Cox
,
M.
,
Arnold
,
G.
, &
Villamayor Tomás
,
S.
(
2010
).
A review of design principles for community-based natural resource management
.
Ecology and Society
,
15
,
38
57
.

Cox
,
M.
, &
Ross
,
J. M.
(
2011
).
Robustness and vulnerability of community irrigation systems: The case of the Taos valley acequias
.
Journal of Environmental Economics and Management
,
61
,
254
266
.

Crawford
,
S
., &
Ostrom
,
E
. (
2005
). A grammar of institutions, Sue Crawford and Elinor Ostrom. In
E.
 
Ostrom
(Ed.),
Understanding the diversity of structured human interactions
(Chapter 5, 1st Ed. pp
137
174
).
Princeton, NJ
:
Princeton University Press
.

Crawford
,
S. E. S.
, &
Ostrom
,
E.
(
1995
).
A grammar of institutions
.
American Political Science Review
,
89
,
582
600
.

Dovers
,
S. R.
, &
Handmer
,
J. W.
(
1992
).
Uncertainty, sustainability and change
.
Global Environmental Change
,
2
,
262
276
.

Dunlop
,
C. A.
, &
Radaelli
,
C. M
.
(
2013
).
Systematising policy learning: From monolith to dimensions
.
Political Studies
,
61
,
599
619
.

Epstein
,
G.
,
Meek
,
C.
,
Ibarra
,
I. P.
, &
Schoon
,
Chanda L
(
2014
).
Governing the invisible commons: Ozone regulation and the Montreal protocol
.
International Journal of the Commons
,
8
,
337
360
.

Epstein
,
G.
,
Pittman
,
J.
,
Alexander
,
S. M.
,
Berdej
,
S.
,
Dyck
,
T.
,
Kreitmair
,
U.
, …
Armitage
,
D.
(
2015
).
Institutional fit and the sustainability of social-ecological systems
.
Current Opinion in Environmental Sustainability
,
14
,
34
40
.

Feiock
,
R. C.
,
Weible
,
C. M.
,
Carter
,
D. P.
,
Curley
,
C.
,
Deslatte
,
A.
, &
Heikkila
,
T.
(
2016
).
Capturing structural and functional diversity through institutional analysis
.
Urban Affairs Review
,
52
,
129
150
.

Fleischman
,
F. D.
,
Ban
,
N. C.
,
Evans
,
L. S.
,
Epstein
,
G.
,
Garcia-Lopez
,
G.
, &
Villamayor-Tomas
,
S.
(
2014
).
Governing large-scale social-ecological systems: Lessons from five cases
.
International Journal of the Commons
,
8
(
2
),
1
15
.

Folke
,
C.
(
2006
).
Resilience: The emergence of a perspective for social-ecological systems analyses
.
Global Environmental Change
,
16
,
253
267
.

Foster
,
S. R.
(
2011
).
Collective action and the urban commons
.
Notre Dame Law Review
,
87
,
57
134
.

Grigg
,
N. S.
(
2011a
).
Governance and management for sustainable water systems
.
London
:
IWA Publishing
.

Grigg
,
N. S.
(
2011b
).
Water governance: From ideals to effective strategies
.
Water International
,
36
,
799
811
.

Grigg
,
N. S
. (
2012
).
Water, wastewater, and stormwater infrastructure management
(2nd Ed.).
Boca Raton, FL
:
CRC Press
.

Hall
,
P. A.
, (
1993
).
Policy paradigms, social learning, and the state: The case of economic policymaking in Britain
.
Comparative Politics
,
25
,
275
296
.

Handmer
,
J. W
. (
1990
).
Flood hazard management
 (1st Ed.).  
Norwich
:
CRC Press
.

Heikkila
,
T.
(
2004
).
Institutional boundaries and common-pool resource management: A comparative analysis of water management programs in California
.
Journal of Policy Analysis and Management
,
23
,
97
117
.

Heikkila
,
T.,
&
Gerlak
,
A. K.
(
2013
).
Building a conceptual approach to collective learning: Lessons for public policy scholars
.
Policy Studies Journal
,
41
,
484
512
.

Heikkila
,
T.
,
Schlager
,
E.
, &
Davis
,
M. W.
(
2011
).
The role of cross-scale institutional linkages in common pool resource management: Assessing interstate river compacts
.
Policy Studies Journal
,
39
,
121
145
.

Howlett
,
M.
&
Cashore
,
B.
(
2009
).
The dependent variable problem in the study of policy change: Understanding policy change as a methodological problem
.
Journal of Comparative Policy Analysis: Research and Practice
,
11
,
33
46
.

Huntjens
,
P.
,
Lebel
,
L.
,
Pahl-Wostl
,
C.
,
Camkin
,
J.
,
Schulze
,
R.
, &
Kranz
,
N.
(
2012
).
Institutional design propositions for the governance of adaptation to climate change in the water sector
.
Global Environmental Change
,
22
,
67
81
.

Ingold
,
K.
(
2014
).
How involved are they really? A comparative network analysis of the institutional drivers of local actor inclusion
.
Land Use Policy
,
39
,
376
387
.

James
,
O.,
&
Lodge
,
M.
(
2003
).
The limitations of ‘policy transfer’ and ‘lesson drawing’ for public policy research
.
Political Studies Review
,
1
,
179
193
.

Jones
,
B. D
. (
2001
).
Politics and the architecture of choice
 (1st Ed.).  
London
:
University of Chicago Press
.

Knill
,
C.
,
Schulze
,
K.
, &
Tosun
,
J.
(
2011
).
Measuring environmental policy change: Conceptual alternatives and research implications. Institute for advanced studies
(p.
38
).
Vienna
:
Reihe Politikwissenschaft Political Science Series
.

Little
,
R. G.
(
2004
).
Tending the infrastructure commons: Ensuring the sustainability of our vital public systems
.
Hong Kong
:
International Workshop on Integrated Life-Cycle Management of Infrastructures
.

Lubell
,
M.
,
Schneider
,
M.
,
Scholz
,
J. T.
,
Mete
,
M.
, &
Schneider
,
M.
(
2016
).
Watershed partnerships and the emergence of collective action institutions
.
American Journal of Political Science
,
46
,
148
163
.

Martens
,
K.,
&
van Weelden
,
P.
(
2014
).
Decision-making on transport infrastructure and contested information: A critical analysis of three approaches
.
European Planning Studies
,
22
,
648
666
.

McGinnis
,
M. D.
(
2011
).
Networks of adjacent action situations in polycentric governance
.
Policy Studies Journal
,
39
,
51
78
.

Moench
,
M.
(
2014
).
Experiences applying the climate resilience framework: Linking theory with practice
.
Development in Practice
,
24
,
447
464
.

Ostrom
,
E
. (
1990
).
Governing the commons: The evolution of institutions for collective action
(22nd print Ed.).
Cambridge
:
Cambridge University Press.
 

Ostrom
,
E
. (
2005a
). Animating institutional analysis. In
E.
 
Ostrom
(Ed.),
Understanding the diversity of structured human interactions
(Chapter 4, 1st Ed., pp.
99
134
).
Princeton, NJ
:
Princeton University Press
.

Ostrom
,
E
. (
2005b
). Robust resource governance in polycentric institutions. In
E.
 
Ostrom
(Ed.),
Understanding the diversity of structured human interactions
(Chapter 9,1st Ed., pp.
255
289
.)
Princeton, NJ
:
Princeton University Press
.

Ostrom
,
E
. (
2005c
). Understanding the diversity of structured human interactions. In
E.
 
Ostrom
 
Understanding the diversity of structured human interactions
(Chapter 1,1st Ed. pp
3
31
.)
Princeton, NJ
:
Princeton University Press
.

Ostrom
,
E
. (
2005d
). Why classify generic rules? In
E.
 
Ostrom
(Ed.),
Understanding the diversity of structured human interactions
(Chapter 6, 1st Ed., pp.
175
185
.)
Princeton, NJ
:
Princeton University Press

Ostrom
,
E.
&
Basurto
,
X.
(
2011
).
Crafting analytical tools to study institutional change
.
Journal of Institutional Economics
,
7
,
317
343
.

Ostrom
,
E
.,
Cox
,
M
., &
Schlager
,
E
. (
2014
). An assessment of the institutional analysis development framework and introduction of the social-ecological systems framework. In
Sabatier
,
P. A
. &
C. M.
 
Weible
(Ed.),
Theories of the policy process
(Chapter 8, pp.
267
306
.)
Boulder, CO
:
Westview Press
.

Ostrom
,
E
. &
Crawford
,
S
. (
2005
). Classifying rules. In
E.
 
Ostrom
(Ed.),
Understanding the diversity of structured human interactions
(Chapter 7,1st Ed., pp.
186
216
.)
Princeton, NJ
:
Princeton University Press
.

Ostrom
,
V.
(
1962
).
The water economy and its organization
.
Natural Resource Journal
,
2
,
55
73
.

Poteete
,
A. R.
,
Janssen
,
M. A.
, &
Ostrom
,
E.
(
2010
).
Working together: Collective action, the commons, and multiple methods
.
Princeton, NJ
:
Princeton University Press
.

Radaelli
,
C. M.
(
1995
).
The role of knowledge in the policy process
.
Journal of European Public Policy
,
2
,
159
183
.

Reid
,
R.,
&
Botterill
,
L. C.
(
2013
).
The multiple meanings of ‘resilience’: An overview of the literature
.
Australian Journal of Public Administration
,
72
,
31
40
.

Roditis
,
M. L.
,
Wang
,
D.
,
Glantz
,
S.A.
, &
Fallin
,
A
.
(
2015
).
Evaluating California campus tobacco policies using the American college health association guidelines and the institutional grammar tool
.
Journal of American College Health
,
63
,
57
67
.

Shepsle
,
K. A.
(
1989
).
Studying institutions
.
Journal of Theoretical Politics
,
1
,
131
147
.

Siddiki
,
S. N.
,
Basurto
,
X.
, &
Weible
,
C. M.
(
2012
).
Using the institutional grammar tool to understand regulatory compliance: The case of Colorado aquaculture
.
Regulation and Governance
,
6
,
167
188
.

Siddiki
,
S. N
.,
Carboni
,
J. L
.,
Koski
,
C
., &
Sadiq
,
A.-A
. (
2015
).
How policy rules shape the structure and performance of collaborative governance arrangements
.
Public Administration Review
,
75
,
536
547
.

Siddiki
,
S. N.
,
Weible
,
C. M.
,
Basurto
,
X.
, &
Calanni
,
J.
(
2011
).
Dissecting policy designs: An application of the institutional grammar tool
.
Policy Studies Journal
,
39
,
79
103
.

Stanovich
,
K. E.
(
2012
).
On the distinction between rationality and intelligence: Implications for understanding individual differences in reasoning
. In
K. J.
 
Holyoak
&
R. G.
 
Morrison
(Eds.),
The oxford handbook of thinking and reasoning
(Chapter 22, pp.
343
365
).
New York
:
Oxford University Press
.

True
,
J. L.
(
2000
).
Avalanches and incrementalism: Making policy and budgets in the United States
.
The American Review of Public Administration
,
30
,
3
18
.

United Nations.
(
2014
).
World urbanization prospects: The 2014 revision, highlights. Technical Report
.
New York, NY
:
United Nations
.

Villamayor-Tomas
,
S
.,
Epstein
,
G
.,
Evans
,
T
., &
Kimmich
,
C
. (
2015
).
The water–energy–food security nexus through the lenses of the value chain and the institutional analysis and development frameworks
.
Water Alternatives
,
8
,
735
755
.

Villamayor-Tomas
,
S.
,
Fleischman
,
F. D.
,
Ibarra
,
I. P.
,
Thiel
,
A.
, &
van Laerhoven
,
F.
(
2014
).
From Sandoz to Salmon: Conceptualizing resource and institutional dynamics in the Rhine watershed through the SES framework
.
International Journal of the Commons
,
8
,
361
395
.

Wildavsky
,
A.
(
1979
). Strategic retreat on objectives: Learning from failure in American public policy.
Speaking truth to power
(pp.
484
496
).
Boston, MA
:
Brown
.

Footnotes

1

In this context, Ostrom (1990, pp. 33–38) clarifies that it is a conscious decision not to include internal/in-mind variables as such, as they are difficult to measure. Hence, scholars give only some indication of where actors’ preferences for a specific rule configuration come from, and on the limitations that these preferences impose on an actor’s ability to make a choice. For instance, Ostrom recognizes that individuals weight benefits of avoiding future harms more heavily than the benefits of producing future goods (Ostrom, 1990, p. 208), which differentiates the IAD from other economic theories that simply assume goal-oriented behaviour.

2

The South Platte River flood hit Denver in 1965, and left an estimated 2.7 billion US dollar (in 2010 dollars) damage. The greatest loss of life occurred during the Big Thompson flood of 1976 with 145 deaths (State of Colorado 2013).

3

McGinnis (2011, p. 171) refers to special districts as an example of specialized, cross-jurisdictional political units within a polycentric governance system. These units have already been focus of IAD-based research on water management in the US (Heikkila, 2004, p. 171).

4

The 2011 CAFR and 2013 CARF were available on www.udfcd.org until 2015, the 2014 CAFR still is available.

5

Coders disagreed in 1 out of 167 cases analysed in this context (99% agreement).

6

Two coders coded statements in the 2011 and 2013 CAFRs. They disagreed in 18 out of 167 cases analysed in this context (89% agreement). Only one coder coded statements in the 2014 CAFR.

7

They coded the minutes for the years 2011 and 2013. Only one coder coded the minutes for the year 2014.

8

The District welcomes CIP requests throughout the year, but the opportunity to change the 5-Year CIP is limited once it is adopted in December.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.