NOAA – Earthquake
Introduction
NCEI archives and assimilates tsunami, earthquake and volcano data to support research, planning, response and mitigation. Long-term data, including photographs, can be used to establish the history of natural hazard occurrences and help mitigate against future events. The NCEI NOAA Earthquake Database contains information on destructive earthquakes from 2150 B.C. to the present that meet at least one of the following criteria: Moderate damage (approximately $1 million or more), 10 or more deaths, Magnitude 7.5 or greater, Modified Mercalli Intensity X or greater, or the earthquake generated a tsunami.
Source: NOAA
Tags: Climate and Environment, Disasters, Time-series, Risk, Daily
Modules
Scrapping:
Below is the API endpoints and the parameters that we need to pass to get the data.
https://www.ngdc.noaa.gov/hazel/hazard-service/api/v1/{dataset}?maxYear={end_year}&minYear={start_year}
Geocoder:
Coordinates are added to the metadata for the country. Region and region code are also appended. Geocoder library is used for getting coordinates. We also have a separate JSON file for country’s coordinates to avoid calling third party library to make geocoding process more efficient and faster.
Standardization:
Additional information like sample frequency, units, source and description are included in the metadata. Function for fetching ISO country code and appending it is present in standardization. Predefined domain and subdomain are added in this step.
Cleaning:
Duplicate and additional columns are removed from the data. Location names are rectified and country names are formatted correctly.
Metadata
Metadata Attributes
| Attributes | Descriptions |
|---|---|
| sourceEqMagnitude | The value in this column contains the primary earthquake magnitude |
| timestamp | standard timestamp used for the timeseries , tsunami was observed |
| id | Id of the event from the original source |
| map_coordinates | Latitude and Longitude of the station location (geojson format |
| country | The country where the tsunami effects were observed. |
| country_code | ISO 3-letter country code |
| description | description of the dataset |
| domain | Predefined domain by Taiyo. |
| name | name of the data |
| original_id | in this case we create our own original id using {city_measure_indicator} |
| region | region for a country according to World Bank Standards} |
| region_code | region code for a region according to World Bank Standards. |
| sample_frequency | frequency in which data gets updated on the source |
| sub_domain | Predefined subdomain by Taiyo. |
| time_of_sampling | time of data collection |
| date_of_sampling | date of data collection |
| timezone | Timezone for the time and date |
| units | Type of value stored in timeseries |
| measure | type of measure (min, max, median) |
| url | url for the each of the datasets. |
| latest_timestamp_id | mongoDB id for latest timestamp in the timeseries |
| income_level | region code for a region according to World Bank Standards. |
| locationName | The location (city, state or island) where the tsunami effects were observed. |
| doubtful | Doubtful values; n Runup entry was not doubtful; y Runup entry was doubtful;m The waves likely had a meteorologic source, and thus were not true tsunami waves |
| eqDepth | |
| eqMagnitude | Valid values: 0.0 to 9.9.The value in this column contains the primary earthquake magnitude. Magnitude measures the energy released at the source of the earthquake. Magnitude is determined from measurements on seismographs. For pre-instrumental events, the magnitudes are derived from intensities. There are several different scales for measuring earthquake magnitudes. The primary magnitude is chosen from the available magnitude scales in this order |
| eqMagMs | The Ms magnitude is the surface-wave magnitude of the earthquake.Valid values: 0.0 to 9.9 |
| publish | TRUE or FALSE |
| intensity | The Modified Mercalli Intensity (Int) is given in Roman Numerals (converted to numbers in the digital database). An interpretation of the values is listed below. The Valid values: 1 to 12 |
| eqMagUnk | The computational method for the earthquake magnitude was unknown and could not be determined from the published sources. |
| area | area where Tsunami effects were observered |
| deaths | Whenever possible, numbers of deaths are listed. |
| deathsAmountOrder | |
| damageAmountOrder | |
| tsunamiEventId | Event Id of Tsunami linked to this earthquake |
| damageAmountOrderTotal | |
| eqMagMb | The Mb magnitude is the compressional body wave (P-wave) magnitude.Valid values: 0.0 to 9.9 |
| eqMagMw | The Mw magnitude is based on the moment magnitude scale. Moment is a physical quantity proportional to the slip on the fault times the area of the fault surface that slips; it is related to the total energy released in the EQ. Valid values: 0.0 to 9.9 |
| housesDestroyedAmountOrder | |
| housesDamagedAmountOrder | |
| housesDestroyedAmountOrderTotal | |
| injuries | Whenever possible, numbers of injuries are listed. |
| injuriesAmountOrder | |
| housesDestroyed | |
| deathsTotal | Whenever possible, total number of deaths from the earthquake and secondary effects are listed. |
| deathsAmountOrderTotal | |
| injuriesTotal | |
| injuriesAmountOrderTotal | |
| housesDestroyedTotal | Total number of houses destroyed |
| damageMillionsDollars | The value in the Damage column should be multiplied by 1,000,000 to obtain the actual dollar amount. |
| housesDamagedAmountOrderTotal | |
| damageMillionsDollarsTotal | |
| housesDamaged | |
| housesDamagedTotal | |
| missingAmountOrderTotal | |
| eqMagMl | The ML magnitude was the original magnitude relationship defined by Richter and Gutenberg for local earthquakes in 1935. It is based on the maximum amplitude of a seismogram recorded on a Wood-Anderson torsion seismograph. Although these instruments are no longer widely in use, ML values are calculated using modern instrumentation with appropriate adjustments.Valid values: 0.0 to 9.9 |
| volcanoEventId | Event Id of Volacano linked to this earthquake |
| missing | |
| missingAmountOrder | |
| missingTotal | |
| eqMagMfa | The Mfa magnitudes are computed from the felt area, for earthquakes that occurred before seismic instruments were in general use.Valid values: 0.0 to 9.9 |
Data Flow
The above data pipeline runs on Argo and it will be executed on a periodic frequency.
DAGs:
- NOAA-Earthquake: Total No of DAGs file is 1
Taiyo Data Format
| Entity | NOAA-Earthquake |
|---|---|
| Frequency | Even Based |
| Updated On | 09-06-2022 UTC 12:14:16 PM |
| - | - |
| Coverage | covering all the countries |
| Uncertainties | - |
| ## Scope for Improvement |
Following can be improved in the next version of the data product:
- Every time Argo Workflow run, we overwrite existing data on the S3 bucket.
- In future we might want to improve it to only scrap the data that we don’t already have.
Useful Links
- https://www.ngdc.noaa.gov/hazard/earthqk.shtml
- https://www.ngdc.noaa.gov/hazel/view/hazards/earthquake/search