Data ingestion

https://terms.codata.org/rdmt/data-ingestion

definition Process of obtaining, importing, and processing data for later use or storage in a database. This process often involves altering individual files by editing their content and/or formatting them to fit into a larger document. An effective data ingestion methodology begins by validating the individual files, then prioritises the sources for optimum processing, and finally validates the results. When numerous data sources exist in diverse formats (the sources may number in the hundreds and the formats in the dozens), maintaining reasonable speed and efficiency can become a major challenge. To that end, several vendors offer programs tailored to the task of data ingestion in specific applications or environments.
editorial note Expert review decision, 2021-22: Edit
type
Resource original
Concept original
in scheme
https://terms.codata.org/rdmt original
has top concept
data-ingestion original
top concept of rdmt original