Skip to main content

Redpoint Data Management™ Documentation

Doc Site Home
Doc Site Tour
Redpoint Global Home

Redpoint Data Management™ Documentation

Main

Doc Site Home
Doc Site Tour
Redpoint Global Home

Main

Welcome to RPDM!

News

RPDM v9.6.2 release

Copyright information

Release notes

Known issues
Deprecation notices
RPDM end-of-life guide

User guide

Data Management overview

Installation and configuration

System requirements
Recommended system sizing for workload
Recommended hardware setup
Upgrading from Redpoint Data Management v8
Install on Windows
Install on Linux
Launch client and connect to services
Configure Data Management for Java
Data Management licensing
Configure initial settings
Configure security
Cryptography and security
Configure groups and users
Data Management configuration files
View software versions
Migrate from one server to another
Uninstall

The Data Management client

The project window
Properties pane
Schema viewer
Run control
Message viewer
Data Viewer tool
Find in Project
Run projects from the client
Exit the client
The Management Dashboard
The Network Monitor
Customize the workspace
Configure user settings

The Site server

Site server settings
Configure Site settings
Configure Machine settings
Configure Resources
Configure tool settings
Multi-threading
Logging
Restart the service

The repository

Repository properties
Permissions
Search repository
Archive and restore repository objects
Back up the repository
Synchronize repository to disk
Projects
Folders
Data objects
Version control
Formulas
Schemas
AutoSave
Advanced repository actions

Clusters

Cloud

Amazon Web Services (AWS)
Microsoft Azure
Google Cloud Storage (GCS)

Build projects

Basic project operations
Working with the tools
Add tools to a project
Specify input and output files
Connect tools
Configure tools
Configure connections
Configure execution options
Priority and triggers
Trigger input and output
Rename tools
Disable tools
Configure data types
Configure project settings
Variables
Project parameters
Annotate projects

Run projects

Tools

Advanced Objects (AOs)

Favorites

Calculate
Change Field Types
Column Splitter
Data Viewer
Filter
Join and Join2
Merge
Number Records
Select
Sort
Splitter
Summarize and Summarize2
Table Lookup
Unique
Validate Order

Input/Output

Analyze file schemas
Layout files
Read a sequence of input files
Write a sequence of output files
File paths and URIs
Refresh connections
Avro tools
Azure Service Bus tools
Azure Storage Queue tools
Blob Input/Output
COBOL Input
CSV Direct/Input/Output
DBF Input/Output
DLD and DLD Index Input/Output
Excel tools
Flat File Input/Output
JMS tools
JSON Input
JSON Output
Kafka tools
Macro Input/Output
Parquet tools

RDBMS tools

Data connections
Configure an RDBMS connection
Install JDBC drivers

RDBMS database providers

RDBMS providers: AWS
RDBMS providers: Azure
RDBMS providers: DB2
RDBMS providers: Excel
RDBMS providers: Generic
RDBMS providers: Google BigQuery
RDBMS providers: MySQL
RDBMS providers: Netezza
RDBMS providers: Oracle
RDBMS providers: PostgreSQL
RDBMS providers: SAP HANA
RDBMS providers: Snowflake
RDBMS providers: SQL Server
RDBMS providers: Sybase
RDBMS providers: Teradata
RDBMS providers: Vertica

Configure RDBMS connection options
RDBMS schemas
RDBMS Input
RDBMS Output
RDBMS Execute
RDBMS In-Database Processor

Salesforce tools
SQS tools
XML Input
XML Input2
XML Output
XML Output2

Miscellaneous

Compress and Decompress
Create Index
Extract Layout
Gateway
Generate Sequence
Join Random
Logging tool
Query Indexed Table
Rank
Rename
Replicate
Splice
Stream to Table and Table to Stream
Throttle
Tall to Wide and Wide to Tall

Address/Spatial

Address Refielder
AO Address Quality
AO Address Report
AO Separate Address
Geocoder
Grid Tile
Loqate
Parse Address
Spatial Decompose
Spatial Input
Spatial Join2 and Spatial Join
Spatial Output
Spatial Process
Spatial Summarize
Standardize Address
Standardize Canadian Address

Complex

Complex file formats
Complex schema
Complex record streams
Complex schema metadata
Complex From Generic
Complex Merge
Complex Sort
Complex Splitter
Complex Text Input
Complex Text Output
Complex XML
Complex To Generic

Document databases

Document data type
Document database field conversion options
Document database arrays
Document tools
MongoDB tools
Cosmos DB tools

External Transform

Extract/Report

AO Simple Crosstab
Crosstab
Defining Data Management Reports
First N and Last N
Reorder
Sample
Structured Report

Matching

Matching with the AOs
AO Business Contact Match
AO Business Match
AO Business Name-Only Match
AO Consumer Match
AO Consumer Match Hierarchical
AO Match Building Block
AO Match Test
Pair-to-Group
Window Compare

Matching Support

AO Associate Match IDs
AO Compile Master
AO Constant Key
AO Constant Key Advanced
AO Define Source
AO Large Word Adjustment
AO Match Reduce Candidate Set
AO Match Segment Analyze
AO Match Super ID
AO Match Validate
AO Max ID
AO Post From Master

Match Results

AO Combined Report
AO Combined Match Report
AO Cross-Source Match Report
AO Cross-Source Record Count Report
AO Cross-Source Summary Report
AO Date Number Reconcile
AO Internal Match Dupe Report
AO Name Reconcile
AO Match Append Info
AO Match Group Differences
AO Match Identify Survivor Record
AO Match Report
AO Match Report by Source
AO Reconcile Match
AO Source Group Count Append

Parsing

AO Business Keyword Parser
AO Business Standardize
AO Classifier
AO Email Parse
AO Field Analyzer
AO Field Validate
AO Multi Line Classifier
AO Multi Line Name Parser
AO Name Genderize
AO Phone Parse
AO SSN Validate
International Phone
Name Parse
Token Creation
Symbol Creation
Pattern Match
Pattern Assembler
Regex
Regex Match Table

Profiling

Public Tools

AO Business Match Assistant
AO Consumer Match Assistant
AO Data Quality Assistant
AO Parsing Assistant
Character Filter
Checksum
Complex Copy Field to Ancestors
Complex Copy Field to Descendants
Complex Renumber
Complex Split by Size
Count Work Days
Error Tool
Find Closest Adv
Make Var Record
Median
Multi Calc
Multi Calc 20
Multi Join
Obscene Words
Pack Fields
Pair to Group Text
PercentileCont
Randomize
Range to Sequence
State from ZIP Code
Straight Compare
Straight Compare Identical Schema
ZIP Codes by State

Public Web Services

AtTask Project Query
Loqate macro
Twitter Search

Machine Learning

Getting started with Machine Learning
Training and predicting
Machine Learning Product Recommender

Web Services

Acxiom Data Services Match
Web service projects
Web Service Input/Output
Web Service Call

Data Management SDK

Build macros

Getting started with macros
Standard macros

Automations

Getting started with automations

Build automations

Build automation: Control steps
Build automation: Data steps
Build automation: External steps
Build automation: Group steps
Build automation: Projects as steps

Run automations
Use variables in automations

Sample projects and automations

Sample projects and automations: Automation

Sample projects and automations: Basic

Analyzing your data
Basic tasks
Cleaning messy data
Equivalents to SQL queries
Fuzzy matching and deduplication
Reformatting and reorganizing
Spatial analysis
Special techniques
Textual pattern matching

Sample projects and automations: COBOL
Sample projects and automations: Complex Schemas
Sample projects and automations: How To
Sample projects and automations: JSON
Sample projects and automations: Machine Learning
Sample projects and automations: Web Services

Common problems

Optimize performance

Tips to optimize performance
Minimize temp space requirements
Use SSDs for temp space
Use performance logs
Record order and performance
Use Validate Order tool to optimize performance
Optimize based on record order
Sort parallelism
Control memory use
Avoid and remove bottlenecks
Avoid split-merge bottlenecks
Avoid chokepoints
Parallelize slow tools

Reference

Expressions
Regular expressions
Regular expressions (Data Management variant)
Symbolic regular expressions
Query expressions

Functions

Binary functions
Boolean functions
Document functions
Date functions
DateTime functions
File System functions
General functions
Hashing functions
HTTP functions
Metadata functions
Numeric functions
Regular expression functions
Regular expression functions (deprecated Data Management variant)
Security functions
Spatial functions
Testing functions

Text functions

Text functions: Part 1
Text functions: Part 2
Text functions: Part 3
Text functions: Part 4

Time functions

Reference: Equivalents to SQL queries
Unicode

Operational API

Install and configure Operational API
Operational API samples

Code pages
Mainframe formatted sequential file
Handling NULL values
Glossary

Copyright and licenses

Third party software
JDBC driver licenses

SDK developer guide

Get started with the Data Management SDK

Understanding the tool lifecycle
Mix-in interfaces
Install prerequisites and the SDK
Supported tool types
Concepts and terms

Explore the sample project
Work with the SDK samples
Configure your tool's user interface
Build and install your tool
Debug your tool
Create plugin functions
Evolve your SDK tool properties
Advanced topics
Frequently asked questions

Breadcrumbs

Home
Redpoint Data Management Documentation
Welcome to RPDM!
News

On this Page

RPDM v9.6.2 release

We’ve released Redpoint Data Management v9.6.2. Please refer to the Release Notes for details.

Redpoint Global Home
Redpoint Support
Redpoint Privacy Policy
Redpoint Subprocessors

Copyright Redpoint Global Inc. All rights reserved.
Powered by Scroll Sites & Atlassian Confluence