Data catalog & data structure

Introduction

Redpoint’s comprehensive and unified framework effectively manages structured data and metadata. This framework enhances customer engagement, facilitating analytics, and streamlining governance workflows. This topic describes:

• The details of Redpoint’s approach to its core data model, which serves as the foundation for its operations.

• The extensibility mechanisms that allow for customization and adaptation to various business needs.

• The internal catalog management processes that ensure data integrity and organization.

• The integration pathways that enable seamless connectivity with third-party catalog systems, thereby enhancing the overall functionality and interoperability of the platform.

Core data model

Redpoint’s core data model supports enterprise-scale customer data platforms (CDPs) as well as sophisticated marketing automation systems. At the heart of this model lies a coherent organizing principle that guarantees not only consistency but also scalability and alignment with governance requirements, making it a robust solution for modern business needs.

Key architectural elements

• Entity-centric design: Key entities, which include Customer, Household, Product, Transaction, and Interaction, are defined with a set of attributes and relationships. This design facilitates identity resolution, segmentation, and personalization, enabling businesses to tailor their interactions with customers effectively.

• Multi-domain support: Redpoint’s data model spans multiple domains, such as marketing, sales, service, and analytics. This multi-domain approach allows for unified views across various business functions, ensuring that all departments can access and utilize the same data effectively, leading to better decision-making and strategic alignment.

• Temporal modeling: The model incorporates time-aware structures that support event tracking and lifecycle transitions. This capability enables longitudinal analysis and time-based segmentation, allowing businesses to understand trends over time and respond to changes in customer behavior proactively.

• Referential integrity: The integrity of the data is rigorously enforced in our data ingestion process through the use of primary and foreign keys, lookup tables, and validation rules. This ensures that the data remains consistent and reliable, which is vital for maintaining trust in the data-driven decisions made by the organization.

• Governance-ready metadata: Each data element within the model is accompanied by metadata that provides information regarding lineage, consent, and auditability. This feature is particularly important for supporting compliance with various regulations such as GDPR, CCPA, and others, ensuring that organizations can manage customer data responsibly and transparently.

Technical highlights

• Schema definitions: The management of schema definitions is handled through Redpoint’s metadata layer, which allows for dynamic updates to the schema without necessitating any code changes, allowing organizations to adapt to evolving business requirements and data structures.

• Integration hooks: The architecture of the model interfaces with Redpoint’s ingestion, transformation, and activation pipelines. This design ensures a smooth and efficient flow of data throughout the system, facilitating real-time data processing and utilization across various applications.

Data model extensibility

Redpoint’s platform supports an extensive range of customization options for the core data model, allowing organizations to tailor it to meet their business requirements and operational needs. This flexibility is crucial for businesses that operate in diverse industries, where standard data models may not adequately capture the complexities of their processes.

Extensibility features

• Custom entities and attributes: Users can define entirely new entities or enhance existing ones by adding additional fields, types, and constraints. This feature empowers businesses to create a data structure that accurately reflects their specific terminology and operational nuances.

• Relationship modeling: The platform supports the creation of complex associations, which can include one-to-many, many-to-many, and even recursive relationships. This flexibility in relationship modeling allows for a more nuanced representation of how different data entities interact with each other within the system.

• Schema evolution: With built-in versioning tools, users can track schema changes over time, ensuring that modifications can be monitored and managed effectively. This includes support for rollback and migration, which helps maintain data integrity and continuity during updates.

• Metadata-driven configuration: Extensions to the data model are defined through metadata, which allows non-technical users to easily configure models using user-friendly interface tools. This democratization of data management means that more team members can contribute to the customization process without needing extensive technical expertise.

• Validation and constraints: The platform allows for the application of custom validation rules, which ensure data integrity across extended schemas. This feature helps organizations maintain high-quality data and adhere to regulatory requirements.

Use cases

• Adding vertical-specific entities, such as Policy and Claim for the insurance industry, allows businesses to tailor their data models to the specific needs of their sector.

• Extending the Customer entity with additional attributes related to loyalty programs or behavioral scores can provide deeper insights into customer interactions and preferences, enabling more effective marketing strategies.

• Modeling campaign hierarchies and attribution paths is another practical application, allowing businesses to track the effectiveness of various marketing initiatives and understand how different campaigns contribute to overall performance.

Data catalog management

Redpoint includes a built-in metadata catalog that serves as the central repository for all data definitions, lineage, and usage metadata.

Catalog capabilities

• Automated metadata capture: Metadata is collected during ingestion, transformation, and activation, ensuring completeness and accuracy.

• Search and discovery: Users can browse and search for data assets, including tables, fields, relationships, and business definitions.

• Lineage: User interface provides information about data flow from source to destination, helping users understand dependencies and impact.

• Role-based access control: Permissions are managed by user roles, ensuring secure and compliant access to catalog assets.

• Governance integration: Supports data quality monitoring and audit logging.

Catalog structure

• Asset registry: Lists all data objects with descriptions, owners, and usage contexts.

• Change tracking: Logs updates to metadata and schema definitions.

Integration with third-party data catalogs

Redpoint integrates with enterprise data ecosystems, including external data catalog platforms.

Integration mechanisms

• RESTful APIs: Redpoint exposes metadata endpoints that can be consumed by platforms like Collibra, Alation, Informatica, and others.

• Metadata export/import: Supports standard formats (JSON, XML, CSV) for metadata exchange and synchronization.

• Custom connectors: Redpoint Professional Services can build connectors tailored to specific client environments.

Benefits

• Enterprise visibility: Enables centralized governance across platforms.

• Interoperability: Facilitates integration with data lakes, warehouses, and BI tools.

• Compliance alignment: Ensures metadata consistency for regulatory reporting and audits.

Conclusion

Redpoint’s unified framework for managing structured data and metadata empowers organizations to enhance customer engagement, streamline analytics, and ensure strong governance. Its core data model is architected for scalability, consistency, and compliance, supporting a wide range of business domains and enabling advanced capabilities such as identity resolution, segmentation, and temporal analysis. The platform’s extensibility allows organizations to tailor data structures and relationships to their unique needs, while built-in catalog management ensures data integrity, discoverability, and governance. Seamless integration with third-party catalog systems further extends Redpoint’s value, enabling interoperability and centralized oversight across the enterprise data ecosystem. Together, these features support robust and scalable data processes for your organization.