OSC Table Status
The most recent datafiles loaded
Upload datafiles
Rebuild the OSC Database
View the Rebuild Log
Beginning database build...Mon 23 Jan 13:00:01 EST 2023
Creating table eia_spot_mkt_prices...
Loading table eia_spot_mkt_prices ...
Creating table eia_spot_mkt_prices_temp...
Loading table eia_spot_mkt_prices_temp...
Inserting into table eia_spot_mkt_prices ...
Creating Indexes on eia_spot_mkt_prices...
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
eia_spot_mkt_prices 0 PRIMARY 1 dt A 14 NULL NULL BTREE
eia_spot_mkt_prices Row Count:
607
Creating table code_regions...
code_regions Row Count:
3198
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
code_regions 1 FIPS_State 1 FIPS_State A 104 NULL NULL BTREE
code_regions 1 State_Abbr 1 State_Abbr A 104 NULL NULL BTREE
code_regions 1 FIPS_County 1 FIPS_County A 809 NULL NULL BTREE
code_regions 1 County 1 County A 3238 NULL NULL BTREE
code_regions 1 State_Abbr_FIPS_County 1 State_Abbr A 104 NULL NULL BTREE
code_regions 1 State_Abbr_FIPS_County 2 FIPS_County A 3238 NULL NULL BTREE
code_regions 1 FIPS_State_FIPS_County 1 FIPS_State A 104 NULL NULL BTREE
code_regions 1 FIPS_State_FIPS_County 2 FIPS_County A 3238 NULL NULL BTREE
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
code_regions 1 FIPS_State 1 FIPS_State A 104 NULL NULL BTREE
code_regions 1 State_Abbr 1 State_Abbr A 104 NULL NULL BTREE
code_regions 1 FIPS_County 1 FIPS_County A 809 NULL NULL BTREE
code_regions 1 County 1 County A 3238 NULL NULL BTREE
code_regions 1 State_Abbr_FIPS_County 1 State_Abbr A 104 NULL NULL BTREE
code_regions 1 State_Abbr_FIPS_County 2 FIPS_County A 3238 NULL NULL BTREE
code_regions 1 FIPS_State_FIPS_County 1 FIPS_State A 104 NULL NULL BTREE
code_regions 1 FIPS_State_FIPS_County 2 FIPS_County A 3238 NULL NULL BTREE
code_regions 1 FIPS_Total 1 FIPS_Total A 3238 NULL NULL BTREE
code_regions 1 iFIPS_Total 1 iFIPS_Total A 3238 NULL NULL YES BTREE
Mon 23 Jan 13:00:19 EST 2023 Creating us_zip table ...
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
us_zip 1 zip 1 zip A 42105 NULL NULL YES BTREE
us_zip 1 city 1 city A 21052 NULL NULL YES BTREE
us_zip 1 county 1 county_name A 1913 NULL NULL YES BTREE
us_zip 1 state 1 state A 62 NULL NULL YES BTREE
us_zip 1 county_state 1 county_name A 1913 NULL NULL YES BTREE
us_zip 1 county_state 2 state A 3238 NULL NULL YES BTREE
Row Count of us_zip table: 42105
insert into osc_data_updates (table_name, datafile ) values('us_zip', 'us_zip.dump.gz' )
2023-01-23 13:00:21 - Creating table egrid_plant
2023-01-23 13:00:21 - Row Count of egrid_plant: 7286
2023-01-23 13:00:21 - Creating indexes on egrid_plant
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
egrid_plant 1 ORISPL 1 ORISPL A 7286 NULL NULL YES BTREE
egrid_plant 1 OPRCODE 1 OPRCODE A 3643 NULL NULL YES BTREE
egrid_plant 1 OPPRNUM 1 OPPRNUM A 1 NULL NULL YES BTREE
egrid_plant 1 UTLSRVID 1 UTLSRVID A 1214 NULL NULL YES BTREE
egrid_plant 1 OPPRNAME 1 OPPRNAME A 1 NULL NULL YES BTREE
2023-01-23 13:00:23 - Updating OPPRNAME with OPRNAME and OPPRNUM with OPRCODE. -1 rows updated.
2023-01-23 13:00:24 - Updated OPPRNAME with OPRNAME and OPPRNUM with OPRCODE. 7286 rows updated.
Archive: Mines.zip
inflating: Mines.txt
dos2unix: converting file Mines.txt to Unix format ...
Loading data files for Mines.txt to the msha_mines_data_set table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/Mines.txt' INTO TABLE msha_mines_data_set FIELDS TERMINATED BY '|' ENCLOSED BY '"' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('msha_mines_data_set', 'Mines.txt' )
Row count before load : 0
Row count after load : 88802
Rows added : 88802
Row count of datafile : 88803
Creating table msha_coal_mine_information...
2023-01-23 13:00:51 - Creating Indexes on msha_coal_mine_information...
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
msha_coal_mine_information 1 Mine_ID 1 Mine_ID A 88802 NULL NULL YES BTREE
msha_coal_mine_information 1 Mine_FIPS_County_Name 1 Mine_FIPS_County_Name A 1776 NULL NULL YES BTREE
msha_coal_mine_information 1 Mine_State_Abbreviation 1 Mine_State_Abbreviation A 54 NULL NULL YES BTREE
msha_coal_mine_information Row Count:
88802
Creating CADETEMP table...
Loading msha_CADE data files for 1983 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1983_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;
script ran, but no update was scheduled
insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1983_5_20090818.txt' )
Row count before load : 0
Row count after load : 9982
Rows added : 9982
Row count of datafile : 9983
Loading msha_CADE data files for 1984 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1984_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1984_5_20090818.txt' )
Row count before load : 9982
Row count after load : 20285
Rows added : 10303
Row count of datafile : 10304
Loading msha_CADE data files for 1985 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1985_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1985_5_20090818.txt' )
Row count before load : 20285
Row count after load : 30233
Rows added : 9948
Row count of datafile : 9949
Loading msha_CADE data files for 1986 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1986_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1986_5_20090818.txt' )
Row count before load : 30233
Row count after load : 40329
Rows added : 10096
Row count of datafile : 10097
Loading msha_CADE data files for 1987 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1987_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1987_5_20090818.txt' )
Row count before load : 40329
Row count after load : 49213
Rows added : 8884
Row count of datafile : 8885
Loading msha_CADE data files for 1988 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1988_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1988_5_20090818.txt' )
Row count before load : 49213
Row count after load : 57250
Rows added : 8037
Row count of datafile : 8038
Loading msha_CADE data files for 1989 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1989_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1989_5_20090818.txt' )
Row count before load : 57250
Row count after load : 64818
Rows added : 7568
Row count of datafile : 7569
Loading msha_CADE data files for 1990 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1990_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1990_5_20090818.txt' )
Row count before load : 64818
Row count after load : 70947
Rows added : 6129
Row count of datafile : 6130
Loading msha_CADE data files for 1991 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1991_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1991_5_20090818.txt' )
Row count before load : 70947
Row count after load : 76695
Rows added : 5748
Row count of datafile : 5749
Loading msha_CADE data files for 1992 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1992_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1992_5_20090818.txt' )
Row count before load : 76695
Row count after load : 82243
Rows added : 5548
Row count of datafile : 5549
Loading msha_CADE data files for 1993 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1993_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1993_5_20090818.txt' )
Row count before load : 82243
Row count after load : 88100
Rows added : 5857
Row count of datafile : 5858
Loading msha_CADE data files for 1994 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1994_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1994_5_20090818.txt' )
Row count before load : 88100
Row count after load : 93267
Rows added : 5167
Row count of datafile : 5168
Loading msha_CADE data files for 1995 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1995_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1995_5_20090818.txt' )
Row count before load : 93267
Row count after load : 97910
Rows added : 4643
Row count of datafile : 4644
Loading msha_CADE data files for 1996 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1996_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1996_5_20090818.txt' )
Row count before load : 97910
Row count after load : 102525
Rows added : 4615
Row count of datafile : 4616
Loading msha_CADE data files for 1997 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1997_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1997_5_20090818.txt' )
Row count before load : 102525
Row count after load : 106641
Rows added : 4116
Row count of datafile : 4117
Loading msha_CADE data files for 1998 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1998_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1998_5_20090818.txt' )
Row count before load : 106641
Row count after load : 110492
Rows added : 3851
Row count of datafile : 3852
Loading msha_CADE data files for 1999 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE1999_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE1999_5_20090818.txt' )
Row count before load : 110492
Row count after load : 114224
Rows added : 3732
Row count of datafile : 3733
Loading msha_CADE data files for 2000 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2000_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2000_5_20090818.txt' )
Row count before load : 114224
Row count after load : 117753
Rows added : 3529
Row count of datafile : 3530
Loading msha_CADE data files for 2001 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2001_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2001_5_20090818.txt' )
Row count before load : 117753
Row count after load : 121040
Rows added : 3287
Row count of datafile : 3288
Loading msha_CADE data files for 2002 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2002_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2002_5_20090818.txt' )
Row count before load : 121040
Row count after load : 124311
Rows added : 3271
Row count of datafile : 3272
Loading msha_CADE data files for 2003 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2003_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2003_5_20090818.txt' )
Row count before load : 124311
Row count after load : 127408
Rows added : 3097
Row count of datafile : 3098
Loading msha_CADE data files for 2004 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2004_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2004_5_20090818.txt' )
Row count before load : 127408
Row count after load : 130542
Rows added : 3134
Row count of datafile : 3135
Loading msha_CADE data files for 2005 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2005_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2005_5_20090818.txt' )
Row count before load : 130542
Row count after load : 133679
Rows added : 3137
Row count of datafile : 3138
Loading msha_CADE data files for 2006 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2006_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2006_5_20090818.txt' )
Row count before load : 133679
Row count after load : 136787
Rows added : 3108
Row count of datafile : 3109
Loading msha_CADE data files for 2007 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2007_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2007_5_20090818.txt' )
Row count before load : 136787
Row count after load : 139827
Rows added : 3040
Row count of datafile : 3041
Loading msha_CADE data files for 2008 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2008_5_20090818.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2008_5_20090818.txt' )
Row count before load : 139827
Row count after load : 142887
Rows added : 3060
Row count of datafile : 3061
Loading msha_CADE data files for 2009 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2009_5_20121011.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2009_5_20121011.txt' )
Row count before load : 142887
Row count after load : 145964
Rows added : 3077
Row count of datafile : 3078
Loading msha_CADE data files for 2010 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2010_5_20121011.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2010_5_20121011.txt' )
Row count before load : 145964
Row count after load : 148931
Rows added : 2967
Row count of datafile : 2968
Loading msha_CADE data files for 2011 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2011_5_20121011.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2011_5_20121011.txt' )
Row count before load : 148931
Row count after load : 151810
Rows added : 2879
Row count of datafile : 2880
Loading msha_CADE data files for 2012 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2012_5_20180102.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2012_5_20180102.txt' )
Row count before load : 151810
Row count after load : 154699
Rows added : 2889
Row count of datafile : 2890
Loading msha_CADE data files for 2013 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2013_5_20140910.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2013_5_20140910.txt' )
Row count before load : 154699
Row count after load : 157383
Rows added : 2684
Row count of datafile : 2685
Loading msha_CADE data files for 2014 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2014_5_20160309.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2014_5_20160309.txt' )
Row count before load : 157383
Row count after load : 159982
Rows added : 2599
Row count of datafile : 2600
Loading msha_CADE data files for 2015 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2015_5_20161019.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2015_5_20161019.txt' )
Row count before load : 159982
Row count after load : 162391
Rows added : 2409
Row count of datafile : 2410
Loading msha_CADE data files for 2016 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2016_5_20180102.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2016_5_20180102.txt' )
Row count before load : 162391
Row count after load : 164696
Rows added : 2305
Row count of datafile : 2306
Loading msha_CADE data files for 2017 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2017_4_20180518.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2017_4_20180518.txt' )
Row count before load : 164696
Row count after load : 167055
Rows added : 2359
Row count of datafile : 2360
Loading msha_CADE data files for 2018 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2018_4_20190311.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2018_4_20190311.txt' )
Row count before load : 167055
Row count after load : 169095
Rows added : 2040
Row count of datafile : 2041
Loading msha_CADE data files for 2019 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2019_5_20200707.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2019_5_20200707.txt' )
Row count before load : 169095
Row count after load : 171037
Rows added : 1942
Row count of datafile : 1943
Loading msha_CADE data files for 2020 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2020_5_20210810.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2020_5_20210810.txt' )
Row count before load : 171037
Row count after load : 172882
Rows added : 1845
Row count of datafile : 1846
Loading msha_CADE data files for 2021 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2021_4_20220605.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2021_4_20220605.txt' )
Row count before load : 172882
Row count after load : 174663
Rows added : 1781
Row count of datafile : 1782
Loading msha_CADE data files for 2022 to the CADETEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/msha_CADE2022_3_20231213.txt' INTO TABLE CADETEMP FIELDS TERMINATED BY 'NONE' LINES TERMINATED BY '
' IGNORE 1 LINES ;insert into osc_data_updates (table_name, datafile ) values('CADETEMP', 'msha_CADE2022_3_20231213.txt' )
Row count before load : 174663
Row count after load : 176416
Rows added : 1753
Row count of datafile : 1754
script ran, but no update was scheduled
Creating and loading the CADETEMP2 table...
CADETEMP2 Record Count:
176416
Creating msha_cade table...
Insert into msha_cade from CADETEMP2...
script ran, but no update was scheduled
Inserting Quarter 1 data into msha_cade...
Inserting Quarter 2 data into msha_cade...
script ran, but no update was scheduled
Inserting Quarter 3 data into msha_cade...
Inserting Quarter 4 data into msha_cade...
script ran, but no update was scheduled
script ran, but no update was scheduled
script ran, but no update was scheduled
Updating msha_cade.AVENEMP...
Creating indexes on msha_cade...
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
msha_cade 0 PRIMARY 1 id A 690325 NULL NULL BTREE
msha_cade 1 YEAR 1 YEAR A 76 NULL NULL YES BTREE
msha_cade 1 MINEID 1 MINEID A 49308 NULL NULL YES BTREE
msha_cade 1 STATDATE 1 STATDATE A 24654 NULL NULL YES BTREE
msha_cade 1 COUNTYNM 1 COUNTYNM A 822 NULL NULL YES BTREE
msha_cade 1 STATEABB_Year 1 STATE_FIPS A 66 NULL NULL YES BTREE
msha_cade 1 STATEABB_Year 2 YEAR A 2396 NULL NULL YES BTREE
msha_cade 1 STATEABB_Year_County 1 STATE_FIPS A 64 NULL NULL YES BTREE
msha_cade 1 STATEABB_Year_County 2 YEAR A 1435 NULL NULL YES BTREE
msha_cade 1 STATEABB_Year_County 3 COUNTY_FIPS A 31378 NULL NULL YES BTREE
msha_cade 1 STATEABB 1 STATE_FIPS A 62 NULL NULL YES BTREE
msha_cade 1 STATE_County 1 STATE_FIPS A 66 NULL NULL YES BTREE
msha_cade 1 STATE_County 2 COUNTY_FIPS A 882 NULL NULL YES BTREE
msha_cade Record Count:
705664
2023-01-23 13:07:13: Creating table eia_923...
2023-01-23 13:07:15: Creating table eia_923_schedule_8a ...
Archive: //home/sites/opensourcecoal.org/data/eia_f4232008_20100316.zip
inflating: eia_f4232008_20100316.csv
Row count of eia_923: 61849
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232008_20100316.csv' )
2009
Archive: eia_f4232009_20110912.zip
inflating: eia_f4232009_20110912.csv
Row count of eia_923: 121990
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232009_20110912.csv' )
2010
Archive: eia_f4232010_20120515.zip
inflating: eia_f4232010_20120515.csv
Row count of eia_923: 180983
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232010_20120515.csv' )
2011
Archive: eia_f4232011_20120305.zip
inflating: eia_f4232011_20120305.csv
Row count of eia_923: 221420
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232011_20120305.csv' )
2012
Archive: eia_f4232012_20140910.zip
inflating: ._eia_f4232012_20140910.csv
inflating: eia_f4232012_20140910.csv
Row count of eia_923: 260507
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232012_20140910.csv' )
2013
Archive: eia_f4232013_20140910.zip
inflating: ._eia_f4232013_20140910.csv
inflating: eia_f4232013_20140910.csv
Row count of eia_923: 294572
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_f4232013_20140910.csv' )
2014
Archive: eia_923_5_2014.zip
inflating: eia_923_5_2014.csv
File line count: 37486 eia_923_5_2014.csv
Row count of eia_923: 332056
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2014.csv' )
2015
Archive: eia_923_5_2015.zip
inflating: eia_923_5_2015.csv
inflating: __MACOSX/._eia_923_5_2015.csv
File line count: 34070 eia_923_5_2015.csv
Row count of eia_923: 366124
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2015.csv' )
2016
Archive: eia_923_5_2016.zip
inflating: eia_923_5_2016.csv
File line count: 30753 eia_923_5_2016.csv
Row count of eia_923: 396875
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2016.csv' )
2017
Archive: eia_923_5_2017.zip
inflating: eia_923_5_2017.csv
inflating: __MACOSX/._eia_923_5_2017.csv
File line count: 44365 eia_923_5_2017.csv
Row count of eia_923: 441238
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2017.csv' )
2018
Archive: eia_923_5_2018.zip
inflating: eia_923_5_2018.csv
File line count: 35568 eia_923_5_2018.csv
Row count of eia_923: 476804
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2018.csv' )
2019
Archive: eia_923_5_2019.zip
inflating: eia_923_5_2019.csv
File line count: 38109 eia_923_5_2019.csv
Row count of eia_923: 514911
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2019.csv' )
2020
Archive: eia_923_5_2020.zip
inflating: eia_923_5_2020.csv
inflating: __MACOSX/._eia_923_5_2020.csv
File line count: 35296 eia_923_5_2020.csv
script ran, but no update was scheduled
Row count of eia_923: 550205
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2020.csv' )
2021
Archive: eia_923_4_2021.zip
inflating: eia_923_4_2021.csv
inflating: __MACOSX/._eia_923_4_2021.csv
File line count: 22785 eia_923_4_2021.csv
Row count of eia_923: 572988
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_4_2021.csv' )
2022
Archive: eia_923_5_2022.zip
inflating: eia_923_5_2022.csv
inflating: __MACOSX/._eia_923_5_2022.csv
File line count: 20428 eia_923_5_2022.csv
Row count of eia_923: 593414
insert into osc_data_updates (table_name, datafile ) values('eia_923', 'eia_923_5_2022.csv' )
2023-01-23 13:08:11: Update eia_923: set mine state to WV where mine state is KY and mine county is 099...
rows affected: 115
funzip error: cannot find input file
Line count of $file: 0 /tmp/eia_923_waste.csv
2023-01-23 13:08:16: Loading eia_923_schedule_8a with eia_923_waste_disposition_2008.csv.gz ...
2023-01-23 13:08:16: Row count of eia_923_schedule_8a is 0
insert into osc_data_updates (table_name, datafile ) values('eia_923_schedule_8a', 'eia_923_waste_disposition_2008.csv.gz' )
funzip error: cannot find input file
Line count of $file: 0 /tmp/eia_923_waste.csv
2023-01-23 13:08:16: Loading eia_923_schedule_8a with eia_923_waste_disposition_2009.csv.gz ...
2023-01-23 13:08:16: Row count of eia_923_schedule_8a is 0
insert into osc_data_updates (table_name, datafile ) values('eia_923_schedule_8a', 'eia_923_waste_disposition_2009.csv.gz' )
funzip error: cannot find input file
Line count of $file: 0 /tmp/eia_923_waste.csv
2023-01-23 13:08:16: Loading eia_923_schedule_8a with eia_923_waste_disposition_2010.csv.gz ...
2023-01-23 13:08:16: Row count of eia_923_schedule_8a is 0
insert into osc_data_updates (table_name, datafile ) values('eia_923_schedule_8a', 'eia_923_waste_disposition_2010.csv.gz' )
eia_form423 Row Count:
70922
2023-01-23 13:08:19 - Creating table FERCTEMP ...
NOTE: FERC data files F423YR72.TXT, F423YR76.TXT, F423YR85.TXT corrupted on MSHA server:
Loading ferc_F423YR data files for 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 to the FERCTEMP table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR72_20090818.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR72_20090818.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR73_20090818.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR73_20090818.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR74_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR74_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR75_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR75_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR76_20090818.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR76_20090818.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR77_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR77_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR78_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR78_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR79_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR79_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR80_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR80_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR81_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR81_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR82_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR82_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR83_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR83_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR84_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR84_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR85_20090818.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR85_20090818.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR86_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR86_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR87_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR87_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR88_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR88_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR89_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR89_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_F423YR90_20090211.txt' INTO TABLE FERCTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('FERCTEMP', 'ferc_F423YR90_20090211.txt' )
Row count before load : 0
Row count after load : 651074
Rows added : 651074
Row count of datafile : 35655
script ran, but no update was scheduled
script ran, but no update was scheduled
2023-01-23 13:08:22 - Creating table ferc423_1972_1990 ...
Inserting into table ferc423_1972_1990...
2023-01-23 13:08:26 - Deleting non-coal or zero quantity rows from table ferc423_1972_1990 ...
rows affected: 243,610
2023-01-23 13:08:28 - Creating index County on table ferc423_1972_1990 for update ...
2023-01-23 13:08:35 - Updating table ferc423_1972_1990 from code_regions...
rows affected: 240,505
ferc423_1972_1990 Row Count:
407464
2023-01-23 13:10:34 - Finished creating table ferc423_1972_1990 ...
Creating table ferc423_1991_1998...
Loading ferc_f423yr data files for 91 92 93 94 95 96 97 98 to the ferc423_1991_1998 table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr91_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr91_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr92_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr92_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr93_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr93_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr94_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr94_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr95_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr95_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr96_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr96_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr97_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr97_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f423yr98_20090211.txt' INTO TABLE ferc423_1991_1998 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1991_1998', 'ferc_f423yr98_20090211.txt' )
Row count before load : 0
Row count after load : 295625
Rows added : 295625
Row count of datafile : 0
Creating table ferc423_1999_2001...
Loading ferc_f423 data files for 1999 2000 2001 to the ferc423_1999_2001 table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4231999_20090211.txt' INTO TABLE ferc423_1999_2001 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1999_2001', 'ferc_f4231999_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232000_20090211.txt' INTO TABLE ferc423_1999_2001 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1999_2001', 'ferc_f4232000_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232001_20090211.txt' INTO TABLE ferc423_1999_2001 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_1999_2001', 'ferc_f4232001_20090211.txt' )
Row count before load : 0
Row count after load : 96339
Rows added : 96339
Row count of datafile : 0
Creating table ferc423_2002_2007...
Loading ferc_f423 data files for 2002 2003 2004 2005 2006 2007 to the ferc423_2002_2007 table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232002_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232002_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232003_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232003_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232004_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232004_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232005_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232005_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232006_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232006_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/ferc_f4232007_20090211.txt' INTO TABLE ferc423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('ferc423_2002_2007', 'ferc_f4232007_20090211.txt' )
Row count before load : 0
Row count after load : 155485
Rows added : 155485
Row count of datafile : 0
Creating table eia423_2002_2007...
Loading eia_f423 data files for 2002 2003 2004 2005 2006 2007 to the eia423_2002_2007 table:
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232002_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232002_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232003_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232003_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232004_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232004_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232005_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232005_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232006_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232006_20090211.txt' )
LOAD DATA LOCAL INFILE '/home/sites/opensourcecoal.org/data/eia_f4232007_20090211.txt' INTO TABLE eia423_2002_2007 FIELDS TERMINATED BY ' ' LINES TERMINATED BY '
' ;insert into osc_data_updates (table_name, datafile ) values('eia423_2002_2007', 'eia_f4232007_20090211.txt' )
Row count before load : 0
Row count after load : 134387
Rows added : 134387
Row count of datafile : 0
script ran, but no update was scheduled
Creating table ferc_423...
Inserting into table ferc_423 from ferc423_1972_1990...
Inserting into table ferc_423 from ferc423_1991_1998...
Inserting into table ferc_423 from ferc423_1999_2001...
Inserting into table ferc_423 from ferc423_2002_2007...
Inserting into table ferc_423 from eia423_2002_2007...
ferc_423 Row Count:
773229
Creating indexes...
Table Non_unique Key_name Seq_in_index Column_name Collation Cardinality Sub_part Packed Null Index_type Comment Index_comment
ferc_423 1 Plant_Code 1 Plant_Code A 580 NULL NULL YES BTREE
ferc_423 1 Mine_State 1 Mine_State A 257743 NULL NULL YES BTREE
ferc_423 1 Mine_State_FIPS 1 Mine_State_FIPS A 773229 NULL NULL YES BTREE
ferc_423 1 Mine_County_FIPS 1 Mine_County_FIPS A 140 NULL NULL YES BTREE
2023-01-23 13:11:25 - Finished creating table ferc_423 ...
Creating the msha_MIFTEMP table...
load_data_files 'msha_MIFTEMP' /tmp/msha_MIF2017_20171027.txt ''
Loading data files for msha_MIF2017_20171027.txt to the msha_MIFTEMP table:
LOAD DATA LOCAL INFILE '/tmp/msha_MIF2017_20171027.txt' INTO TABLE msha_MIFTEMP FIELDS TERMINATED BY '' LINES TERMINATED BY '