Transforming Data Management Landscape with WhereScape RED 10.0.0.0
The future of data management is here with WhereScape RED 10.0.0.0. This iteration builds on its predecessors' successes, providing an even more robust, versatile, and efficient solution for your data infrastructure needs. The new features and enhancements are designed to facilitate a seamless transition towards a data-driven organization. It includes a PostgreSQL metadata repository, fully templated code generation, integration with Azkaban scheduler, introduction of Action Scripts, Linux execution support, and much more.
PostgreSQL Metadata Repository
The PostgreSQL Metadata Repository is an innovative feature that significantly enhances the efficiency of WhereScape RED. Storing metadata within a PostgreSQL database eradicates the dependence on Microsoft, enabling the use of cloud or hosted PostgreSQL services. This has a tremendous impact on scalability and flexibility. By decoupling the repository from the target platform, performance improvements are substantial, especially where target platforms are resource-constrained.
Fully Templated
One of the biggest highlights of WhereScape RED 10.0.0.0 is the introduction of fully templated code generation. This feature provides users with full control over how the code is generated, greatly increasing customization and flexibility. The templates are defined using Pebble and can be used to generate code in any language. This feature is operating system agnostic, allowing the generation of Python and Powershell that can be executed on both Windows or Linux platforms.
Configurable elements include validation templates to detect when metadata is out of sync with physical objects. This encompasses tables, views, indexes, and more. Also included are DDL templates to CREATE/DROP/ALTER new or changed objects, data ingestion or Load scripts, data transformation or Update scripts, and Data Export scripts. WhereScape RED 10.0.0.0 also extends source connections and user-defined browse scripts, providing connectivity to any data source accessible via a command line or script.
Azkaban Scheduler Integration
The integration of WhereScape RED with Azkaban scheduler ushers in an era of enhanced process automation. This integration introduces features such as a browser-based console, restartable jobs from the point of failure, updated graphical views during execution, native email alerting, and advanced schedule timing options. These additions significantly improve the software's scalability and control, with new executors able to be added, load balancing, and job control via the Rest API. The 'Publish template' design also opens up the possibility for publishing to other schedulers in the future, like Airflow or Azure Data Factory.
Action Scripts
Action Scripts add a new dimension to the capabilities of WhereScape RED. The code associated with Scheduled task 'actions' is now templated and configurable, allowing for fine-level control over the actions executed on the scheduler. Different object types like tables, views, indexes, exports, and scripts have different configurable actions. In future releases, the definition of additional actions will be enabled, expanding potential for new Enablement Packs.
Linux Execution Support
Recognizing the need for cross-platform operability, WhereScape RED 10.0.0.0 now supports the execution of generated scripts for all object types on a Linux/Unix server, in addition to the Windows machine. This change applies to execution via the scheduler, which can also be run on Linux or Windows, extending the tool's flexibility and reach.
Beyond these notable features, WhereScape RED 10.0.0.0 also introduces improvements in the installation and upgrade process, object size limits, UI/UX, compatibility with WhereScape 3D, and licensing. There's also a new Setup Wizard that is 'Enablement Pack aware' that provides a GUI for installing and updating Enablement Packs and allows connection 'Targets' to be defined if they do not exist. This shows WhereScape's commitment to user experience and their dedication to providing a robust data management tool.
From smaller changes like increasing object size limits to significant enhancements like the integration with the Azkaban Scheduler and the introduction of Action Scripts, each feature adds value to the overall tool, creating a more efficient, reliable, and effective data management solution. The benefits these features bring are hard to overstate, as they significantly simplify and speed up the data management process, freeing up resources for other important tasks.
Overall, the improvements and additions in WhereScape RED 10.0.0.0 make it a data management tool that truly stands out in the market. It's a remarkable solution that provides robust, flexible, and efficient data infrastructure development. Its extensive set of features are designed to meet the needs of organizations of all sizes, from small start-ups to large enterprises. It's a tool that not only meets current needs but also anticipates future data management requirements, setting new standards for data management software.