Data transformation

MediationData mediationtransformationtransformingImportmediatemediatedmediatorsmore existtransform
In computing, Data transformation is the process of converting data from one format or structure into another format or structure.wikipedia
79 Related Articles

Data integration

Customer data integrationintegrationintegrate
It is a fundamental aspect of most data integration and data management tasks such as data wrangling, data warehousing, data integration and application integration.
the trend in data integration favored loosening the coupling between data and providing a unified query-interface to access real time data over a mediated schema (see Figure 2), which allows information to be retrieved directly from original databases.
Big dataData transformationData warehouseData architectureOntology-based data integration

Transformation language

transformation
Stratego/XTData transformationBidirectional transformationComputer languageFormal language

Code generation (compiler)

code generationcode generatorgenerator
(See also: Program transformation, Data transformation.)
CompilerIntermediate representationProcessor registerRuntime (program lifecycle phase)Compiler-compiler

Extract, transform, load

ETLETL (Extract-Transform-Load)extract, transform and load
Data extraction involves extracting data from homogeneous or heterogeneous sources; data transformation processes data by data cleansing and transforming them into a proper storage format/structure for the purposes of querying and analysis; finally, data loading describes the insertion of data into the final target database such as an operational data store, a data mart, data lake or a data warehouse.
Data warehouseExpense and cost recovery systemStaging (data)Operational data storeData extraction

Text editor

text editorstext editingeditor
A text editor like emacs or TextPad supports the use of regular expressions with arguments.
Word processorFormatted textScalable Vector GraphicsPlain textLine editor

Data mapping

mappingmappingslink the data
Data integrationData transformationData wranglingSemantic mapperSemantic translation

AWK

AWK programming languagegawk
Domain-specific languageData-driven programmingScripting languageRegular expressionStream (computing)

Data management

managementData maintenancedata-management
It is a fundamental aspect of most data integration and data management tasks such as data wrangling, data warehousing, data integration and application integration.
Data governanceData miningOutline of academic disciplinesDataData architecture

Data wrangling

Data mungingData wrangler
It is a fundamental aspect of most data integration and data management tasks such as data wrangling, data warehousing, data integration and application integration.
Data mappingOpenRefineTrifactaRaw dataContent format

Data warehouse

data warehousingdata warehousesEnterprise Data Warehouse
It is a fundamental aspect of most data integration and data management tasks such as data wrangling, data warehousing, data integration and application integration.
Operational data storeOperational systemBusiness reportingBusiness intelligenceData integration

Master data

master data or reference data managementmaster reference data
A master data recast is another form of data transformation where the entire database of data values is transformed or recast without extracting the data from the database.
Master data managementDynamic dataUnstructured dataHierarchical database modelMetadata

Database

database management systemdatabasesDBMS
A master data recast is another form of data transformation where the entire database of data values is transformed or recast without extracting the data from the database.
Relational databaseDatabase modelNoSQLTable (database)Database application

Table (database)

tabletablesdatabase table
All data in a well designed database is directly or indirectly related to a limited set of master database tables by a network of foreign key constraints.
DatabaseRelational databaseRow (database)Primary keyTable (information)

Foreign key

Foreignforeign key constraintforeign key references
All data in a well designed database is directly or indirectly related to a limited set of master database tables by a network of foreign key constraints.
Relational databaseReferential integrityNull (SQL)Database normalizationData integrity

Database index

indexindexesindexing
Each foreign key constraint is dependent upon a unique database index from the parent database table.
Partial indexHash tableSQLDatabaseB-tree

Applications architecture

application architectureApplication Architect
Also, the database recast must be done in such a way as to not impact the applications architecture software.
Architecture domainThe Open Group Architecture FrameworkEnterprise architecture planningInformation systemEnterprise architecture

Data model

structured datastructuredData models
When the data mapping is indirect via a mediating data model, the process is also called data mediation.
Data modelingUnstructured dataEnterprise modellingProgramming languageLogical schema

Grammar

grammaticalgrammaticallyrules of language
LinguisticsPhoneticsPhraseSyntaxSentence clause structure

Backus–Naur form

BNFBackus-Naur formBNF grammar
Context-free grammarMetasyntaxSyntax (programming languages)John BackusAugmented Backus–Naur form

SPARK (programming language)

SPARKSPARK programming languageSPARK/Ada
Another advantage of the recent DSL trend is that a DSL can abstract the underlying execution of the logic defined in the DSL, but it can also utilize that same logic in various processing engines, such as Spark, MapReduce, and Dataflow.
Ada (programming language)Design by contractVermont Lunar CubeSatAltran PraxisList of tools for static code analysis

MapReduce

Map Reducemap-reducemap/reduce
Another advantage of the recent DSL trend is that a DSL can abstract the underlying execution of the logic defined in the DSL, but it can also utilize that same logic in various processing engines, such as Spark, MapReduce, and Dataflow.
Big dataReduce (parallel pattern)Programming modelApache HadoopMap (parallel pattern)

Emacs

GNU EmacsEmacs pinkyEmacsWiki
A text editor like emacs or TextPad supports the use of regular expressions with arguments.
GNU EmacsOrg-modeEditor warDiredMacro (computer science)

TextPad

A text editor like emacs or TextPad supports the use of regular expressions with arguments.
List of text editorsComparison of text editorsText editorMicrosoft WindowsOperating system

Perl

Perl 5Perl programming languagePerl Script
Interpreter (computing)Larry WallLearning PerlRegular expressionSed

Web template system

template enginetemplatestemplate
Template processorWeb pageWebsiteGenshi (templating language)Jinja (template engine)