View our recorded webinar with Datameer and Data Tools Pro discover how you can optimize your Salesforce data migration process in 2023 using a reverse ETL process powered by Datameer and Snowflake. This webinar will be presented by Datameer and Ryan Goodman, creator of Data Tools Pro. Ryan will showcase how Datameer has been the secret sauce to accelerate a reverse ETL data stack to effectively prepare, transform, and analyze data.
Whether you’re a Salesforce administrator, a data analyst, or data professional, this webinar will equip you with practical insights to streamline your data migration. Don’t miss out on this opportunity to learn and ask live questions how to enhance your data migration practices.
What you will Learn?
During the webinar, we’ll cover , real-world examples of successful reverse ETL scenarios for Snowflake specifically for Salesforce. Additionally, Ryan will share best practices and pitfalls to avoid during a typical Salesforce.com data migration.
A year ago, I worked on a small project to help us improve our data driven funnel. I learned what I called “Snowflake to Salesforce analytics sync” had a more buzzworthy term called “Reverse ETL.” This article shares some of the lessons learned along the way and some thoughts about where reverse ETL is headed.
Low Level of Effort Solution
All of the data and metrics were already available and calculated in Snowflake for reporting, so the process to push those measurements back into a Salesforce object using Azure Data Factory was quite simple.
Snowflake has helped democratize the data platform eliminating layers of technology and administrative traditionally required to enable data workers. The next generation of data preparation tools arrived in recent years and continues to accelerate the process for preparing business ready data assets.
In my previous role managing data and analytics, I had a big problem. All of my data was staged in Snowflake but data engineering was backlogged with requests and my analysts were stuck between SQL and the last generation of desktop BI data preparation tools. I solved this problem and tripled my team’s throughput with Datameer.
Datameer is a native Snowflake data preparation and analysis solution that does not require extracting any data out of Snowflake. I used for all of my BI reporting and dashboard projects, allowing me to roll out 3 times more business ready data assets in 2 months than the first 5 months of my Snowflake initiative.
There are a few key features of Datameer that helped us wrangle data faster. Enterprise data is imperfect, so you need the right tools to profile, explore, and understand imperfections while you build.
Data-Driven Join Analysis
One of these features is Join Analysis, which offers unmatched Rows that enable me to quickly see which records fall out of the left and right side of the join. With this feature, I can easily identify records that are missing IDs or recognize that I didn’t fully understand the grain of data before I joined. The Join Keys analysis feature also identifies duplicate records and highlights which data source is causing duplicates or potential cartesian products as a result of duplicate keys. These features enable me to understand my data both inside and out of each join, allowing me to move forward more efficiently in my data flow.
Another useful feature of Datameer is inline no-code Data Exploration. This feature is essential when exploring data and validating it with collaborators. Datameer provides intuitive and fast exploration capabilities so you can create many cuts of data through your data pipeline. You can employ filtering, aggregation, binning, and sorting. It only takes about 5 minutes to master this feature, and it has enough functionality to cover most real-world slicing and dicing. For repeatable or reusable scenarios, the exploration nodes feature enables me to make my exploration view available or deploy it as its own view back to Snowflake for recurring validation.
Field Exploration is yet another useful feature of Datameer, as it prepares a summary profile for each field and provides a visual reference point for quickly identifying outliers, NULLs, district values, and unique records. This feature is similar to Snowflake and helps me quickly and efficiently understand my data.
Datameer is No-code where you want it.. SQL Coding where you need it
Datameer offers a no-code user experience that will technically allow you to build and deploy business intelligence views and tables without writing a line of code. There are conversely many experienced SQL developers who are more proficient writing SQL than using no-code interfaces. Datameer is best of both worlds because you can visually abstract your SQL code into a flow and have all Snowflake SQL functions on hand. This way you can still beneifit from the aforementioend features while coding. Datameer with generate your SQL as a CTE that runs natively on Snowflake.
Change Tracking and Revisions
In addition to a rich meta and tagging, Datameer offers deployment history and version control natively, allowing you to comment revisions, single click restoration to previous deployments in Snowflake, and full access to the SQL code.
Overall, I am impressed with Datameer’s capabilities and look forward to every release with incremental updates focused on bringing data teams and data analysts together in a practical solution.
