X

Track changes made to this page

If you find this page useful and would like to be notified of changes made to this page, start by inputting your email below.



Privacy policy
Close this window

powered by ChangeDetection

Difference between revisions of "Alberta Oil and Gas Data Sources"

(Statistical Reports)
 
(19 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
__TOC__
 
__TOC__
 +
=Alberta Data Releases=
  
  
=Statistical Reports=
+
==Alberta v1.0 (August 2015)==
  
The source of information for all Alberta Well Data is the [http://www.aer.ca/data-and-publications/statistical-reports/ website of Alberta Energy Regulator]  and all The information was extracted from the following reports:
+
This was the first release of Alberta oil and gas well data on WellWiki and included data reported through July 2015. As part of this project we created 580,719 new Alberta Well Pages and 14,706 new Alberta Operator Pages. With this release, WellWiki’s total coverage reached 1.4 million oil and gas wells. Data for this update were downloaded in mid-July 2015 and consisted primarily of data available at no cost from the Alberta Energy Regulator. Specifically, we utilized the following reports:  
  
 +
  •  ST37: List of Wells in Alberta<ref>{{cite web | title = ST37: List of Wells in Alberta | url = http://www1.aer.ca/ProductCatalogue/10.html}}</ref>
  
 +
  •  ST102: Facility List<ref>{{cite web | title = ST102: Facility List | url = http://www1.aer.ca/ProductCatalogue/35.html}}</ref>
  
'''1) Statistical Report ST37 – well list and following fields'''
+
  • ST103: Field and Pool Code List<ref name = 'a4'>{{cite web | title = ST103: Field and Pool Code List | url = http://www1.aer.ca/ProductCatalogue/36.html}}</ref>
  
 +
  •  ST104: Business Associate Codes<ref>{{cite web | title = ST104: Business Associate Codes | url = http://www1.aer.ca/ProductCatalogue/37.html}}</ref>
  
The starting point for WellWiki.org’s Alberta well data is publication ST37, “List of  Wells in Alberta.” This publication is updated monthly and is available for download from the AER website. ST37 includes the following information for all oil and gas wells in the province:
+
  •  Horizontal Well List<ref>{{cite web | title = Horizontal Well List | url = http://www1.aer.ca/ProductCatalogue/395.html}}</ref>
  
  
• well identifier
+
We also utilized data on orphaned wells from the Orphan Well Association. The team included Joel Gehman, Mason Strong and Hailey Mussleman.
  
• well name
 
  
• license number
+
==Alberta v2.0 (December 2018)==
  
• field/pool and/or area/deposit
+
This update expanded WellWiki’s coverage of Alberta oil and gas wells through May 2018. This was one of the most complex upgrades to WellWiki since the site’s original launch, involving the design and development of a completely new database schema, known internally as “wellsdb2018.” This new database design included 27 separate tables. A total of 597,809 Well Pages were updated or created and the overall information provided on each well was expanded to include spud activities, directional drilling and fracking activities, comprehensive production data, perforation treatments, and notable occurrences. We also updated or created 18,432 Operator Pages. As part of this upgrade, we implemented a new geocoding procedure, which appended the county or municipal location to each oil and gas well. Using these data, we created 206 County and Municipality Pages, a feature not available as part of our Alberta v1.0 release. Additionally, these pages included infoboxes<ref>{{cite web | title = Infoboxes | url = https://en.wikipedia.org/wiki/Help:Infobox}}</ref> sourced from Wikipedia. Critical to the success of this release was access to a number of subscription-only data products available from the Alberta Energy Regulator. Overall, we utilized the following reports:
  
operator
+
  General Well Data File – All Alberta<ref name = 'a1'>{{cite web | title = General Well Data File – All Alberta | url = http://www1.aer.ca/ProductCatalogue/237.html}}</ref>
  
licensee
+
  Well Production Data File – All Alberta<ref name = 'a2'>{{cite web | title = Well Production Data File – All Alberta | url = http://www1.aer.ca/ProductCatalogue/271.html}}</ref>
  
total depth
+
  ST49: Daily Spud and Drilling Activity List<ref name = 'a3'>{{cite web | title = ST49: Daily Spud and Drilling Activity List| url = http://www1.aer.ca/ProductCatalogue/19.html}}</ref>
  
finished drilling date
+
  ST103: Field and Pool Code List<ref name = 'a4'>{{cite web | title = ST103: Field and Pool Code List | url = http://www1.aer.ca/ProductCatalogue/36.html}}</ref>
  
well status
+
  Hydraulic Fracturing Water Source and Water Use Data<ref name = 'a5'>{{cite web | title = Hydraulic Fracturing Water Source and Water Use Data | url = http://www1.aer.ca/ProductCatalogue/530.html}}</ref>
  
  
 +
The team for this project consisted of Joel Gehman, Cole Miller, and Jared Pattison. Funding for the project was provided in part by financial support from the Alberta Real Estate Foundation and the Social Sciences and Humanities Research Council of Canada, as well as in-kind support from the Alberta Energy Regulator and the University of Alberta School of Business.
  
The information about the meaning of each field in the well table is available [http://www.aer.ca/documents/sts/St37-Listofwellslayout.pdf here]
 
  
 +
==Alberta v2.1 (February 2019)==
  
 +
This release did not update the data on WellWiki, but made several improvements. First, we implemented an “alias” enhancement to the Alberta Well Pages, providing two alternative identifiers for each well, thereby facilitating a broader range of potential user searches. We also fixed a page size limit and a memory limit that were preventing a few very long County Pages from displaying (e.g., Cypress County, Wheatland County) and fixed an error in the way that Well Pages referenced County and Municipality Pages. The team for this project consisted of Joel Gehman and Cole Miller.
  
We downloaded the tab-delimited text file and imported this file into our MySQL relational database. As of the May 1, 2015, release this file included 17 fields and 584,588 wells. We also downloaded the shapefiles.
 
  
 +
==Alberta v3.0 (May 2019)==
  
 +
This upgrade added 12 months of new data to WellWiki, including activity reported by the Alberta Energy Regulator through the end of April 2019. Our data for this update came from multiple sources:
  
'''2) Statistical Report ST103-Pool field codes'''
+
  •  General Well Data File – All Alberta<ref name = 'a1'>{{cite web | title = General Well Data File – All Alberta | url = http://www1.aer.ca/ProductCatalogue/237.html}}</ref>
  
http://www.aer.ca/data-and-publications/statistical-reports/st103
+
  •  Well Production Data File – All Alberta<ref name = 'a2'>{{cite web | title = Well Production Data File – All Alberta | url = http://www1.aer.ca/ProductCatalogue/271.html}}</ref>
  
All lists contained ion this report are updated monthly except the Commingled Pool List which is updated daily Lists are available as Microsoft Excel files, PDFs or tab delineated
+
  •  ST49: Daily Spud and Drilling Activity List<ref name = 'a3'>{{cite web | title = ST49: Daily Spud and Drilling Activity List| url = http://www1.aer.ca/ProductCatalogue/19.html}}</ref>
  
 +
  •  ST103: Field and Pool Code List<ref name = 'a4'>{{cite web | title = ST103: Field and Pool Code List | url = http://www1.aer.ca/ProductCatalogue/36.html}}</ref>
  
 +
  •  Hydraulic Fracturing Water Source and Water Use Data<ref name = 'a5'>{{cite web | title = Hydraulic Fracturing Water Source and Water Use Data | url = http://www1.aer.ca/ProductCatalogue/530.html}}</ref>
  
'''3) Statistical Report ST104- Licensee Agent Codes (Operators)'''
 
  
http://www.aer.ca/data-and-publications/statistical-reports/st104
+
As part of this upgrade, we implemented an enhancement to our Operator and Municipality Pages, notably to include “operator” on Municipality Pages and “municipality” on Operator Pages. Overall, this upgrade resulted in the generation of 613,139 new or modified Alberta Well Pages; {{PAGESINCATEGORY:Alberta_Operators}} new or modified Alberta Operator Pages; and 207 new or modified Alberta County and Municipality Pages. The team for this project consisted of Joel Gehman, Cole Miller, Alireza Azimi, Michael Boisvert, and Ankesh Kumar. Funding for the project was provided in part by financial support from the Social Sciences and Humanities Research Council of Canada and the University of Alberta, as well as in-kind support from the Alberta Energy Regulator and the University of Alberta School of Business.
  
This Report replaced the previously published Company Codes list. It provides Business Associate (BA) codes for companies. It includes licensees and agents but also includes companies (e.g., drilling companies) that have codes but are not registered licensees or agents. it is available as a PDF or as a Microsoft Excel spreadsheet.
 
  
 +
==References==
 +
<references/>
 +
__NOEDITSECTION__
  
 
+
[[Category:Documentation]]
'''4) Statistical Report ST108- AER Monthly Enforcement Action Summary (Compliance)'''
 
 
 
http://www.aer.ca/data-and-publications/statistical-reports/st108
 
 
 
 
 
ST108, “Monthly Enforcement Action Summary” was published from January 2008
 
 
 
through June 2014, inclusive, a total of 66 monthly reports. Each report provided a
 
 
 
summary of the regulator’s compliance activity. We downloaded all archived copies of
 
 
 
ST108, and incorporated them into our database of Alberta well data. Unfortunately,
 
 
 
these reports were published as PDF files, requiring that we transform them into machine
 
 
 
readable, structured text suitable for insertion into our MySQL database.
 
 
 
 
 
 
 
The regulator’s compliance activity is now available through the AER’s 
 
 
 
"[http://www1.aer.ca/ComplianceDashboard/index.html Compliance Dashboard]"
 
 
 
 
 
 
 
 
 
'''5) Statistical Report ST102-Facility List'''
 
 
 
http://www.aer.ca/data-and-publications/statistical-reports/st102
 
 
 
ST 102 is a complete list of batteries, gas plants, meter stations, and other facilities in Alberta. The list has been expanded from previous iterations and now includes additional information frequently requested by customers, such as operator name and facility sub-type description. It is in two parts:
 
 
 
 
 
Part A - List of New and Active Facilities
 
 
 
 
 
Part B - List of Other Facilities
 
 
 
Both of which are available for download in TXT or PDF formats.
 
 
 
 
 
'''6) Horizontal Well List'''
 
 
 
http://www.aer.ca/data-and-publications/activity-and-data/horizontal-well-list
 
 
 
 
 
 
 
 
 
'''7)Well coordinates are extracted from AGS coordinate converter tool'''
 
 
 
http://www.ags.gov.ab.ca/gis/map_converters/conversion_tools.html
 
 
 
=Statistical Report Table Descriptions=
 
 
 
The following are summaries of the Important tables within the Statistical reports mentioned above:
 
 
 
 
 
==Table ab_well==
 
 
 
{| class="wikitable"
 
! Column Name
 
! Description
 
|-
 
| LOCATION column
 
| This column in the database represents
 
well id in UWI format. In this id is encoded the location of well. The
 
information on decoding the meaning can be found here
 
 
 
dl.ppdm.org/dl/551
 
|-
 
| WELL_ID column
 
| This column contains the well id in the well DNS format. It encodes the location of the well and the information on the meaning of each digit can be found here:
 
 
 
dl.ppdm.org/dl/551
 
|-
 
| WELL_NAME column
 
|
 
|-
 
| POOL_CODE column
 
| References to ab_pool_code table
 
|-
 
| OS_DEP_CODE column
 
|
 
|-
 
| FINAL_DRILLING_DATE column
 
|
 
|-
 
| TOTAL_DEPTH column
 
|
 
|-
 
| WELL_STATUS_CODE column
 
| This field encodes the status of the
 
well. The information from this field is decoded and added to the table in the following fields:,FLUID, MODE, TYPE, STRUCTURE. The information is decoded according to:
 
 
 
[http://www.aer.ca/documents/sts/St37-Listofwellslayout.pdf www.aer.ca/documents/sts/St37-Listofwellslayout.pdf]
 
|-
 
| WELL_STATUS_DATE column
 
|
 
|-
 
| FLUID column
 
| Obtained from WELL_STATUS_CODE
 
|-
 
| MODE column
 
| Obtained from WELL_STATUS_CODE
 
|-
 
| TYPE column
 
| Obtained from WELL_STATUS_CODE
 
|-
 
| STRUCTURE column
 
| Obtained from WELL_STATUS_CODE
 
|-
 
| CONFIGURATION column
 
| Contains information if the well is horizontal. The data was loaded to this table from the list of horizontal well list (see the 6-th resource in the resource section)
 
|-
 
| HORIZONTAL_WELL column
 
| Contains information if the well is horizontal. The data was loaded to,this table from the list of horizontal well list (see the 6-th resource,in the resource section)
 
|-
 
| LONGITUDE_DECIMAL column
 
| This information was extracted from the online converter (see the 7-th resource in the resource section)
 
|-
 
| LATITUDE_DECIMAL column
 
| This information was extracted from the online converter (see the 7-th resource in the resource section).
 
NOTE: extracted information for this column has a positive value. In order to see the actual location of the well in Google Maps, this location has to be turned to negative value. I left this value to be positive in order to be consistent with the source.
 
|}
 
 
 
==Table ab_pool_codes==
 
 
 
This Table can be found  in the "Field/Pool List" section of the ST103 statistical Report
 
 
 
{| class="wikitable"
 
! Column Name
 
! Description
 
|-
 
| FIELD_NAME column
 
|-
 
| PRODUCTION_POOL column
 
|-
 
| FIELD_CODE column
 
|-
 
| PRODUCTION_POOL_CODE column
 
|-
 
| GEOLOGICAL_POOL_CODE column
 
|-
 
| GEOLOGICAL_POOL_NAME column
 
|-
 
| CONFIDENTIAL column
 
|-
 
|}
 
 
 
==Table ab_operator==
 
 
 
This Table is available in Statistical report 104 (ST104):  https://www.aer.ca/data-and-publications/statistical-reports/st104
 
 
 
This table replaces the Company Codes list previously published by the AER. It provides Business Associate (BA) codes for companies and includes licensees and agents but also includes companies (e.g., drilling companies) that have codes but are not registered licensees or agents.
 
 
 
{| class="wikitable"
 
! Column Name
 
! Description
 
|-
 
| BA_CODE column
 
| Code of the business unit
 
|-
 
| COMPANY column
 
| Company name
 
|-
 
| ADDRESS column
 
| Address of the company. Initially this column contained the information for the street number, city, province and postal code. This information was extracted and used to populate the corresponding fields. For some cases, this information was incomplete.
 
|-
 
| CITY column
 
|
 
|-
 
| PROVINCE column
 
|
 
|-
 
| POSTAL_CODE column
 
|
 
|-
 
| PHONE column
 
|
 
|-
 
| COUNTRY column
 
| Country information was populated according to the information in the PROVINCE column. The codes were decoded according USA USPS codes:
 
 
 
http://en.wikipedia.org/wiki/List_of_U.S._state_abbreviations#Postal_codes
 
|}
 
 
 
==Table ab_permit==
 
 
 
{| class="wikitable"
 
! Column Name
 
|-
 
| LOCATION column
 
|-
 
| OS_DEP_CODE column
 
|-
 
| LICENSE_SEQ column
 
|-
 
| LICENSE_DATA column
 
|-
 
| LICENSE_CODE column
 
|-
 
| FINAL_DRILLING_DATA column
 
|}
 
 
 
==Table ab_permit==
 
 
 
The table Can be found in Statistical report 108 ([http://www.aer.ca/data-and-publications/statistical-reports/st108 ST108]
 
) which provides a summary of the regulator's compliance activity: 
 
{| class="wikitable"
 
! Column Name
 
! Description
 
|-
 
| LICENSEE column
 
|
 
|-
 
| NONCOMPLIANCE_DESC column
 
|
 
|-
 
| ENORCEMENT_DATE column
 
|
 
|-
 
| LOCATION column
 
|
 
|-
 
| RISK_CATEGORY column
 
|
 
|-
 
| AER_GROUP column
 
| Information in this column was added from the AER_ACTIONS_AND_LICENSEE_RESPONSE. The original column from source was containing two pieces of information and it was required to be split in two (normalization principle)
 
|-
 
| COMPLIANCE CATEGORY column
 
| Information in this column was added from the AER_ACTIONS_AND_LICENSEE_RESPONSE. The original column from source was containing two pieces of information and it was required to be split in two (normalization principle)
 
|-
 
|
 
|
 
|-
 
|
 
|
 
|-
 
|
 
|
 
|}
 
 
 
==Table ab_facility==
 
 
 
The data for the below fields is drawn from ST 102. The report is a complete list of batteries, gas plants, meter stations, and other facilities in the province. Additionally the list has been expanded to include additional information such as operator name and facility sub-type description.
 
 
 
 
 
{| class="wikitable"
 
! Column Name
 
|-
 
| FACILITY_ID column
 
|-
 
| FACILITY_NAME column
 
|-
 
| OPERATOR_CODE column
 
|-
 
| OPERATOR_NAME column
 
|-
 
| SUB_TYPE_CODE column
 
|-
 
| SUB_TYPE column
 
|-
 
| LE column
 
|-
 
| LSD column
 
|-
 
| Legal Subdivision
 
|-
 
| SEC column
 
|-
 
| Section
 
|-
 
| TWP column
 
|-
 
| Township
 
|-
 
| RNG column
 
|-
 
| Range
 
|-
 
| MER column
 
|-
 
| Meridian
 
|-
 
| LICENSE_NUMBER column
 
|-
 
| EDCT_CODE column
 
|-
 
| EDCT_DESCRIPTION column
 
|-
 
| LICENSE_CODE column
 
|-
 
| OPERATIONAL_STATUS column
 
|}
 

Latest revision as of 14:53, 29 August 2019

Alberta Data Releases

Alberta v1.0 (August 2015)

This was the first release of Alberta oil and gas well data on WellWiki and included data reported through July 2015. As part of this project we created 580,719 new Alberta Well Pages and 14,706 new Alberta Operator Pages. With this release, WellWiki’s total coverage reached 1.4 million oil and gas wells. Data for this update were downloaded in mid-July 2015 and consisted primarily of data available at no cost from the Alberta Energy Regulator. Specifically, we utilized the following reports:

 •  ST37: List of Wells in Alberta[1]
 •  ST102: Facility List[2]
 •  ST103: Field and Pool Code List[3]
 •  ST104: Business Associate Codes[4]
 •  Horizontal Well List[5]


We also utilized data on orphaned wells from the Orphan Well Association. The team included Joel Gehman, Mason Strong and Hailey Mussleman.


Alberta v2.0 (December 2018)

This update expanded WellWiki’s coverage of Alberta oil and gas wells through May 2018. This was one of the most complex upgrades to WellWiki since the site’s original launch, involving the design and development of a completely new database schema, known internally as “wellsdb2018.” This new database design included 27 separate tables. A total of 597,809 Well Pages were updated or created and the overall information provided on each well was expanded to include spud activities, directional drilling and fracking activities, comprehensive production data, perforation treatments, and notable occurrences. We also updated or created 18,432 Operator Pages. As part of this upgrade, we implemented a new geocoding procedure, which appended the county or municipal location to each oil and gas well. Using these data, we created 206 County and Municipality Pages, a feature not available as part of our Alberta v1.0 release. Additionally, these pages included infoboxes[6] sourced from Wikipedia. Critical to the success of this release was access to a number of subscription-only data products available from the Alberta Energy Regulator. Overall, we utilized the following reports:

 •  General Well Data File – All Alberta[7]
 •  Well Production Data File – All Alberta[8]
 •  ST49: Daily Spud and Drilling Activity List[9]
 •  ST103: Field and Pool Code List[3]
 •  Hydraulic Fracturing Water Source and Water Use Data[10]


The team for this project consisted of Joel Gehman, Cole Miller, and Jared Pattison. Funding for the project was provided in part by financial support from the Alberta Real Estate Foundation and the Social Sciences and Humanities Research Council of Canada, as well as in-kind support from the Alberta Energy Regulator and the University of Alberta School of Business.


Alberta v2.1 (February 2019)

This release did not update the data on WellWiki, but made several improvements. First, we implemented an “alias” enhancement to the Alberta Well Pages, providing two alternative identifiers for each well, thereby facilitating a broader range of potential user searches. We also fixed a page size limit and a memory limit that were preventing a few very long County Pages from displaying (e.g., Cypress County, Wheatland County) and fixed an error in the way that Well Pages referenced County and Municipality Pages. The team for this project consisted of Joel Gehman and Cole Miller.


Alberta v3.0 (May 2019)

This upgrade added 12 months of new data to WellWiki, including activity reported by the Alberta Energy Regulator through the end of April 2019. Our data for this update came from multiple sources:

 •  General Well Data File – All Alberta[7]
 •  Well Production Data File – All Alberta[8]
 •  ST49: Daily Spud and Drilling Activity List[9]
 •  ST103: Field and Pool Code List[3]
 •  Hydraulic Fracturing Water Source and Water Use Data[10]


As part of this upgrade, we implemented an enhancement to our Operator and Municipality Pages, notably to include “operator” on Municipality Pages and “municipality” on Operator Pages. Overall, this upgrade resulted in the generation of 613,139 new or modified Alberta Well Pages; 3,547 new or modified Alberta Operator Pages; and 207 new or modified Alberta County and Municipality Pages. The team for this project consisted of Joel Gehman, Cole Miller, Alireza Azimi, Michael Boisvert, and Ankesh Kumar. Funding for the project was provided in part by financial support from the Social Sciences and Humanities Research Council of Canada and the University of Alberta, as well as in-kind support from the Alberta Energy Regulator and the University of Alberta School of Business.


References