Elevate Your Data Security with Customer Managed Key Encryption – Discover Striim Shield

As businesses embrace digital transformation, safeguarding sensitive information is critical. Striim 5.0 brings a powerful new feature: Striim Shield, that enables customers to take control of their data encryption through Customer Managed Keys. This innovative feature empowers organizations to securely manage their data before it flows further downstream while ensuring compliance with business policies and industry regulations. Let’s explore what Striim Shield can do for you and how it adds value to your business.

What Does Striim Shield Do?

Striim Shield allows users to encrypt specific data fields using keys provided by the customer through Google KMS (Key Management Service). This encryption ensures that sensitive data is securely stored in external targets, while customers maintain control over the encryption keys used. The keys are refreshed regularly (every few days), ensuring that your data stays secure over time. Striim does not manage these keys, giving customers the autonomy to handle their encryption requirements.

How Do You Use Striim Shield?

Users only have to specify the field to be encrypted and link Shield with their Google KMS.  Shield uses Google Tink, an open-source encryption library developed by Google Cloud, for envelope encryption operations. The data encryption key is encrypted in-memory with the customer’s Google KMS key and published along with the encrypted data.   

Google KMS manages the key operations to ensure that different keys are used during the encryption. There are two modes for key refresh:

  • Time-based refresh (set to refresh every 1 day by default)
  • Event-based refresh (refreshes after a set number of events)

To decrypt the data, customers must use their Google KMS keys that they provided during the encryption by Shield. Customers can encrypt the  encrypted message using Striim Shield, or they can do it outside of Striim using Google Tink. 

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

  • Striim Shield delivers several key advantages for businesses: Data Control: Customers retain full control of their data encryption and encrypted data, ensuring sensitive information is protected according to their business needs or regulatory requirements.
  • Built for Longevity: Google Tink, maintained by Google Cloud, ensures that Striim Shield is always up to date, backward-compatible, and built to last.
  • Security and Transparency: Striim does not create, store or manage encryption keys, guaranteeing that customers maintain full control over the encryption and their sensitive data.
  • Granular Encryption: You can encrypt selected columns or fields, enabling more precise control over which data is encrypted before being written to the target. 
  • Collaboration with Security: Share datasets with internal or external teams without compromising sensitive data, using encryption to manage access to critical fields.

Transform Your Business with Striim Shield – Try It Today!

Striim 5.0’s Striim Shield gives your organization a robust, secure way to manage data encryption while fostering collaboration and ensuring compliance. Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

Streamline Security and Efficiency with OAuth 2.0

With the release of Striim 5.0, businesses can now experience enhanced security and ease of integration through Striim’s support for OAuth 2.0 . This simplifies the authentication processes and ensures a smoother experience for administrators while keeping security a top priority. Let’s dive into how OAuth works, how to use it, and the value that Striim adds to your business.

What Does OAuth Do?

OAuth, or Open Authorization, is a widely-used open-standard authorization method that can seamlessly connect you with different apps and services without requiring you to create a new account every time or divulge sensitive information such as passwords, thereby enhancing security and reducing friction. OAuth uses access tokens to prove your identity to another service, and should this other service suffer a breach, your original credentials on the first service will remain safe. The access tokens also contain the data sharing rules between the services that can reduce the risk of unauthorized data access.

How Do You Use It?

Setting up OAuth is simple and can be done directly within Striim’s user interface. Striim has introduced a new feature called Connection Profiles that securely stores the information about the connections to an external service.  Whether you’re configuring it through the adapter itself or managing all your connections from the “Manage Striim” > “Connection Profiles” screen, the process is seamless. The introduction of a “Sign In Using OAuth” button makes it easier than ever to authenticate once and then authorize Striim to use your connection profiles across different adapters.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s OAuth streamlines user configuration with minimal overhead. Once the Connection Profile is set up, Striim connects you to the external service and ensures that you remain connected by regularly reauthenticating to the external service in accordance with their rules.  You can use the Connection Profiles across multiple adapters to connect to the same external service, smooth and secure communication with endpoints with minimum overhead. The use of OAuth in Connection Profiles simplifies the authentication and authorization process process, saving time and reducing the complexity typically involved with maintaining OAuth credentials.

Transform Your Business with OAuth – Try It Today!

OAuth in Striim 5.0 is designed to enhance security, reduce manual intervention, and make OAuth configuration easier than ever. 

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

 

Striim 5.0 Release: Enhancing Data Processing with Striim’s Vector Embeddings Generator

Extracting meaningful insights from vast amounts of data is crucial for businesses to remain competitive. One powerful tool that has emerged in recent years is vector embeddings. These compact numerical representations of data not only facilitate enhanced data analysis but also improve search capabilities and machine learning tasks. Striim has harnessed the power of vector embeddings to provide its customers with a robust tool for transforming raw data into meaningful insights in real-time.

What does the Vector Embeddings Generator Feature Do?

Striim’s vector embedding generator offers a streamlined way to create and manage these embeddings directly within the platform. The Embedding Generator supports SQL transformations, enabling users to tailor the data columns for embedding generation, thus enhancing the relevance and accuracy of the embeddings produced. Striim supports a range of popular embeddings models, including those from OpenAI and VertexAI, ensuring users can choose the model that best fits their needs. The generated embeddings can then be written directly to databases that support vector storage, making it easy for customers to integrate these embeddings into their existing analytics workflows.

How do you use it?

Using Striim’s Vector Embedding Generator is straightforward, thanks to two main methods available to users:

  1. Using the Striim UI: From the Striim AI link on the Striim UI, customers can perform CRUD operations (Create, Read, Update, Delete) on the embedding generator. This makes it easy to manage and configure the embedding models.
  2. Using the Striim Console: For users who prefer scripting, they can use regular SQL commands to create or replace the embedding generator object directly, providing flexibility and control over their data pipelines.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s vector embedding generator is a significant asset for businesses looking to enhance their real-time data processing capabilities. By embedding vectors directly within the Striim platform, customers can generate meaningful insights without needing additional tools or adding complexity to their workflows. This streamlined approach not only reduces costs but also minimizes administrative overhead, making it an ideal solution for organizations seeking efficiency and simplicity in their data integration processes.

Case Study: Enhancing Business Value with Striim’s Vector Embeddings – UPS Capital

UPS Capital is a prime example of how Striim’s vector embeddings can add value to businesses. By integrating Striim’s real-time data streaming technology with Google BigQuery’s analytics capabilities, UPS Capital improved their data processing and analytical capabilities significantly. Striim enabled UPS to ingest data from various sources immediately, facilitating real-time risk assessments and proactive decision-making. The data seamlessly flowed into Google BigQuery, where advanced analytics and machine learning were used to predict delivery risks and optimize logistics strategies. The innovative DeliveryDefense™ Address Confidence system, powered by Striim, leveraged these embeddings to assign confidence scores to delivery locations, thus improving predictive accuracy and allowing businesses to manage delivery risks effectively. This use case highlights the transformative power of Striim’s vector embeddings in enhancing data efficiency and real-time analytical capabilities.

Transform Your Business with Striim’s Vector Embeddings – Try It Today!

Striim’s vector embeddings generator is a game-changer for businesses looking to enhance their data processing and analytical capabilities in real time. By integrating this powerful tool into your data workflows, you can streamline operations, improve predictive accuracy, and drive better decision-making.

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

Striim 5.0 Release: Streamlining Schema Creation with Striim’s Integrated Schema Feature

Migrating schemas within a data pipeline has traditionally been a complex and time-consuming task for many users. However, Striim’s latest 5.0 release introduces an integrated schema creation feature that simplifies this process significantly, making it more accessible and efficient. This feature is integrated into the configuration process of many adapters, providing users with an automated and streamlined approach to schema management.

What Does Integrated Schema Creation Do?

The integrated schema creation feature in Striim enables users to automatically create schemas on their target endpoints directly through the Striim configuration panel. This capability is particularly beneficial for users who manage complex data pipelines, allowing them to initiate the schema creation step of migration with minimal effort, seamlessly from source to target. By setting the CreateSchema flag to True in the configuration, users can initiate this feature.

How Do You Use It?

To use the integrated schema creation feature, follow these steps:

  1. Configuration to Enable Schema Creation:
    • Source – Database Reader: Set the CreateSchema option to True.
    • Target Adapter: Set the CDDLAction to Process.

  1. This configuration enables the source adapter to resolve the interested tables and objects, fetching their structure. It then publishes schema creation events to the stream for all the objects involved. Once schema events are published, data events sequentially follow for the objects, ensuring that data is synchronized with the newly created schema.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s integrated schema creation feature is a game-changer for anyone managing complex data pipelines. Before Striim’s 5.0 release, users had to perform schema creation through standalone utilities or wizards, which often involve multiple steps and external processes. The integrated schema creation feature eliminates the need for these separate tools and additional manual steps. By simplifying the user experience, reducing complex steps and skills by fully automating the process of table creation on target endpoints, Striim reduces implementation time and thus faster returns on the investments. This feature highlights Striim’s simplicity of providing robust, user-friendly solutions that enhance productivity and efficiency in data management. Whether you’re handling a small database or a large-scale data environment, Striim’s integrated schema creation is a powerful tool for streamlining your data operations.

Take Your Data Operations to the Next Level with Striim 5.0

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

Striim 5.0 Release: Introducing Fast Snapshot Loads to Accelerate Your Data Movement

As part of Striim’s 5.0 release, Fast Snapshot Loads is designed to elevate how organizations manage data loading for analytics. With this new feature, Striim makes it easier to create, manage, and accelerate the loading of database table snapshots. Fast Snapshot Loads harnesses declarative property syntax to intelligently distribute and parallelize table movement —significantly reducing load times and making large-scale data integration timely and more efficient.

What does Fast Snapshot Load achieve?

Fast Snapshot Loads optimizes the process of creating and managing database table snapshots, intelligently scheduling and distributing table loading  across parallel executions. This significantly boosts  throughput performance for initial data loads and reduces the time required to make data available for analytics.

How Do You Use Fast Snapshot Loads?

Activating Fast Snapshot Loads is simple and integrates seamlessly within Striim’s intuitive platform. Just specify the parallelism counts in the property fields of the Striim Database Reader and Data Warehouse Writer adapters. Striim then automatically manages the table distribution and scheduling execution to maximize performance on the Striim server.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Fast Snapshot Loads brings several powerful benefits to users, designed to streamline data loading and boost productivity:

  • Enhanced Performance: Achieve up to 60% faster load times with Parallel adapter settings, optimizing initial data loads for faster insights.
  • No-Code Solution: Minimize setup complexity by reducing the need for custom coding, making it easier to configure and deploy than prior Striim versions.
  • Accelerated Time-to-Value: Reduce the time spent on design and development, allowing teams to build high-performance initial load solutions quickly.
  • Automated Distribution: Striim handles distribution and scheduling of tables automatically, removing the need for manual setup by data engineers.

Experience the Power of Striim 5.0

Fast Snapshot Loads is ideal for data analytics use cases and supports Striim’s key data warehouse adapters, including Google BigQuery, Snowflake, Microsoft Fabric, and Databricks. Discover how Fast Snapshot Loads can transform your data performance—contact us today for a demo or to connect with a Striim expert! 

Striim 5.0 Release: Unlock Real-Time Customer Insights with the Intercom Reader

Customer engagement is crucial for businesses to thrive, and platforms like Intercom have made it easier than ever to connect with users through messaging tools for sales, marketing, and customer care. Striim 5.0’s new Intercom Reader makes it even easier by enabling seamless real-time data integration from the Intercom platform into your analytics systems. Let’s dive into how the Intercom Reader works, how you can use it, and the value it brings to your business.

What Does It Do?

The Intercom Reader allows you to connect directly to your Intercom platform and read data from user-defined tables. It captures the necessary data and emits WAEvents, which can be propagated to any supported target systems, such as Google BigQuery, Snowflake, or Microsoft Azure Synapse. This real-time data integration empowers businesses to gain immediate insights from their customer interactions, driving better decision-making across sales, marketing, and customer service teams.

How Do You Use It?

Striim makes it simple to get started with the Intercom Reader in two different modes:

  1. Initial Load: For loading historical data from your Intercom platform, you can set the mode in the Intercom Reader to perform an initial load of your defined tables. This ensures that you have all the data needed to build a comprehensive picture of your customer interactions.
  2. Incremental Load: After the initial load, you can switch to the “Incremental Load” mode for continuous, near-real-time replication of data. The adapter reads new data at regular intervals, keeping your analytics up to date with the latest information from Intercom.

To get started, you can use Striim’s user-friendly wizards, which will guide you through connecting to your Intercom instance and writing data to your desired target. Additionally, for more complex configurations, you can use Striim’s flow designer (a graphical programming tool) or TQL (query-based) to create or edit your applications.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s real-time data integration capabilities bring several benefits:

  • Non-Intrusive and Secure Data Collection: Striim collects data securely and reliably from your Intercom platform without disrupting your operations, allowing for continuous, real-time customer insights.
  • Cloud Integration: Striim supports streaming data to popular cloud analytics platforms like Google BigQuery, Snowflake, Microsoft Azure Synapse, and Databricks Delta Lake, ensuring your data can be analyzed with the tools you already use.
  • Data Freshness SLAs: With Striim, you can set data freshness SLAs, ensuring that your teams have access to the most up-to-date information, which builds trust among business users and supports quick decision-making.
  • In-Flight Data Processing: Striim offers in-flight processing such as filtering, transformations, aggregations, enrichment, and correlations. These capabilities allow you to make the most out of your data by refining and enhancing it before it reaches your target systems.

Transform Your Business with Real-Time Customer Insights

The Striim Intercom Reader helps you unlock the power of your Intercom data, providing real-time insights that enhance customer engagement and support business growth. 

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

 

Striim 5.0 Release: Introducing Stripe Reader Connector for Real-Time Payment Data Insights

As businesses increasingly rely on SaaS solutions like Stripe for payment processing, Striim’s integration makes it easier to move, analyze, and leverage payment data in real time. This connector helps streamline data workflows, allowing customers to consolidate their payment data and gain valuable insights faster than ever before.

What Does the Stripe Reader Do?

The Stripe Reader is designed to help users move payment data from the Stripe service provider into any target supported by Striim. Stripe is a popular payment solution for online businesses, particularly those with subscription-based models. With this connector, Striim users can now seamlessly extract data from Stripe and send it to destinations such as Google BigQuery, enabling advanced analytics and data consolidation.

How Do You Use It?

Using the Stripe Reader with Striim is simple and straightforward. To get started, create a Striim application and use the setup wizard for a quick and seamless configuration. The wizard walks you through adding Stripe as a source and connecting your Stripe instance securely via OAuth authentication. Once connected, you can easily select the Stripe objects (tables) you want to work with and define your destination target, such as BigQuery.

For advanced users, Striim’s Flow Designer offers deeper customization options, allowing you to tailor data flows to your specific needs. This layered approach ensures both new and experienced users can maximize the value of Striim, making it a versatile solution for integrating Stripe data. The following section dives further into how Striim’s features amplify efficiency and control for complex data workflows.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s integration of the Stripe Reader adds significant value by allowing businesses to consolidate their data workloads across multiple sources. With Striim, you can combine on-premises databases (via CDC) with SaaS payment data from Stripe, enabling real-time analytics across all your business data. This level of integration and real-time capability would be challenging to achieve with other tools, making Striim a powerful solution for modern data-driven enterprises.

One of the standout features is the “mode=Automated” option. With this setting, the connector initially reads all the data from selected objects and then switches to incremental loading, ensuring ongoing updates are seamlessly captured. This flexibility makes it easy to keep your data pipeline running efficiently.

Additionally, Striim’s new support for the Stripe Delete Event handler allows users to track deleted data from Stripe objects without needing to perform a full resync, unlike some competitor products. This not only saves time but also reduces operational costs, making it a more efficient and cost-effective solution.

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

 

Striim 5.0 Release: Unlock Real-Time Salesforce Integration with Powerful New Connectors

Striim’s suite of connectors for Salesforce applications helps organizations streamline this process by enabling seamless, real-time data movement between Salesforce and other systems. Whether you’re working with Salesforce CRM, Pardot, or Salesforce Marketing Cloud, Striim simplifies the data integration experience.

What Does It Do?

Striim provides both read and write connectors for Salesforce applications, enabling real-time data movement across multiple Salesforce environments. Here’s how Striim connects to various Salesforce applications:

  • Salesforce Reader: Reads data from Salesforce using REST APIs, supporting Initial Load and Incremental Sync.
  • Salesforce Platform Event Reader: Specifically reads Platform Events, allowing you to capture event-driven changes.
  • Salesforce CDC Reader: Uses the Streaming API to fetch Change Data Capture (CDC) events, ensuring you capture every update in real time.
  • Salesforce Cloud Account Engagement (Pardot) Reader: Reads Pardot data using REST APIs to support marketing efforts.
  • Salesforce Marketing Cloud Writer: Pushes data to Salesforce Marketing Cloud (B2C) using REST APIs to support marketing initiatives.

How Do You Use It?

Using Striim’s Salesforce connectors is simple. Whether you’re reading data from Salesforce, capturing events, or writing insights back to Salesforce applications, the connectors provide the flexibility to integrate data with ease.

For read operations, Striim pulls data from Salesforce systems, including CRM, Pardot, and Marketing Cloud, making it available for downstream analytics or other business processes. The write operations then push insights or enriched data back into Salesforce, ensuring that your marketing and sales teams have up-to-date information to drive business decisions.

Striim’s real-time, low-latency pipeline enables businesses to keep Salesforce systems updated in near real time, supporting initiatives like Next Best Action and Real-time Personalization.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim’s real-time data movement capabilities provide a range of benefits:

  • Fastest Real-Time Data Movement: By using Salesforce CDC (Change Data Capture) in real time, Striim enables faster and more reliable data updates compared to batch processing.
  • Reverse ETL Capabilities: Striim’s writers allow for reverse ETL scenarios, pushing insights from analytics systems back into Salesforce applications. This helps enable real-time personalization and next best action scenarios.
  • Bi-Directional Pipelines: Combining the Salesforce CDC Reader with Striim’s Snowflake CDC Reader creates the fastest bi-directional pipelines, keeping both Salesforce and Snowflake in sync.
  • Unified Platform: Striim integrates Salesforce with other databases, providing a unified platform for handling all your Salesforce data pipelines.

Experience the Power of Striim 5.0

Maximize the value of Striim’s Salesforce connectors by optimizing your Salesforce API quota. By combining the power of Salesforce CDC with the versatility of Salesforce Reader, Striim ensures real-time data movement that aligns with your business goals. With Striim, Salesforce data integration is seamless, fast, and ready for action—keeping your business agile and efficient. 

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

Striim 5.0 Release: Introducing Automated Pipelines for Effortless Data Replication

The release of Striim 5.0 brings a powerful new feature, Automated Pipelines, designed to transform how businesses handle real-time data replication. Automated Pipelines empowers organizations to deploy high-performance, streaming data replication applications with just a few clicks, making complex replication processes simple and accessible for teams at any scale.

What Does Automated Pipelines Do?

Automated Pipelines allows users to create robust, low-latency data pipelines from source to target with ease, ensuring that data flows smoothly and consistently across platforms. This feature takes on the heavy lifting of configuring streaming replication, enabling businesses to move data from source systems to target environments with minimal effort and intervention. By reducing the setup complexity, it enables organizations to focus more on data-driven insights and less on infrastructure setup.

How Do You Use It?

Setting up data replication with Automated Pipelines in Striim is a straightforward, intuitive process:

  1. Select Your Source: Choose the database or data source you want to replicate.
  2. Choose Tables: Select specific tables or collections to move, ensuring you get precisely the data needed.
  3. Set Your Target: Pick the target platform where the data will be replicated.
  4. Click Start: With a simple click, your pipeline is deployed and begins streaming data in real time.

Striim’s Automated Pipelines also allow advanced configurations, such as compute-separation, for both initial load and Change Data Capture (CDC) operations. This gives users the flexibility to define different levels of compute resources for each stage of the pipeline, optimizing performance and cost efficiency based on the specific needs of the replication task.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

While many data replication solutions face a trade-off between scalability and performance, Striim’s Automated Pipelines offer a unique advantage. It combines scalability with high-performance real-time replication, making it easy to handle massive data volumes without sacrificing speed. This is particularly valuable for enterprises with high transactional workloads that need to keep up-to-date data flowing across analytics platforms, operational data stores, or data lakes.

Automated Pipelines stands out by delivering both simplicity and power, allowing organizations to efficiently manage real-time data replication without the need for extensive configurations or dedicated technical teams. It’s a game-changer for any organization looking to leverage data seamlessly across environments, enabling real-time decision-making and operational agility with minimal setup time.

Transform Your Business with Automated Pipelines – Try It Today!

Striim 5.0’s Automated Pipelines brings replication speed, ease, and control together, setting a new standard for streaming data pipelines in today’s data-driven landscape. Try out our automated pipelines today and unlock new insights from your data! 

Start Your Free Trial | Schedule a Demo

 

Striim 5.0 Release: Supercharge Your Data Integration with Microsoft Dataverse Writer

Organizations need to ensure their systems are integrated seamlessly for efficient decision-making. Striim’s 5.0 release introduces the Microsoft Dataverse Writer, a powerful target adapter that enhances how businesses integrate and write data to Microsoft Dataverse. With its ability to handle both standard and custom objects, Striim allows companies to unlock real-time insights and drive more informed decisions across their operations.

What Does It Do?

The Microsoft Dataverse Writer adapter is designed to write events to Microsoft Dataverse using the Dataverse Web API. By leveraging the ODATA standard REST interfaces of Dataverse, this adapter supports all basic Data Manipulation Language (DML) operations. It allows you to write events to both standard and custom objects within a Dataverse instance. The adapter can handle writing large groups of events—up to 1000 events in a single OData Batch API call—offering significant scalability for enterprises. Additionally, you can configure an expiration property for the batch, adding flexibility in managing data flow.

How Do You Use It?

Using the Microsoft Dataverse Writer is simple and adaptable to your business needs. The adapter connects to a Dataverse instance using either a manual password credential grant flow or an automated OAuth flow with a public OAuth app. This flexibility ensures that you can securely and efficiently authenticate and authorize the connection between Striim and your Dataverse instance, giving you control over how data is managed and processed.

Want to dive deeper? Check out the doc and explore more.

How Does Striim Add Value?

Striim provides immense value by enabling real-time data flow with high throughput and low latency. This ensures that businesses can handle large-scale data with minimal delay, providing immediate insights and improving decision-making processes. For example, Striim can power hyper-personalized marketing campaigns by integrating data across platforms, prioritize high-value customer interactions through lead and account scoring, and optimize operations like customer support ticket management, pricing, and inventory.

Plus, Striim’s integration with Microsoft Dataverse enhances the flexibility and accuracy of your data by supporting both standard and custom objects. Although the adapter currently does not support relationships across tables (like foreign keys), the ability to specify key columns ensures data consistency and integrity across your operations.

Transform Your Business Today!

Striim’s Microsoft Dataverse Writer empowers businesses to harness the full potential of their Dataverse data, driving real-time insights and enabling smarter business strategies. 

Ready to power your business with real-time data? Try Striim today with a free trial or book a demo to see it in action.

Start Your Free Trial | Schedule a Demo

 

Back to top