Best of Data Management — July 2024

  1. 1
    Article
    Avatar of swizecswizec.com·2y

    Why SQL is Forever

    SQL and relational databases remain fundamental for transactional data, despite the advances and popularity of NoSQL technologies over the past decades. Many NoSQL systems have either been removed, adapted to include SQL/natively support transactions, or are mainly used for caching and analytics. This demonstrates the enduring flexibility and utility of SQL, including new features like JSON support and vector databases, which relational databases have successfully integrated while maintaining ACID properties.

  2. 2
    Article
    Avatar of builderiobuilder.io·2y

    Understanding and Implementing Structured Data

    Structured data helps organizations organize and standardize their information for easier access and updates, improving decision-making and efficiency. Unstructured data, which constitutes around 80-90% of data, requires specialized tools to analyze. Implementing structured content models and using a CMS can significantly enhance SEO, personalization, and dynamic content delivery across multiple platforms. Headless CMS and modular UI components further support flexible, sustainable digital experiences.

  3. 3
    Article
    Avatar of theknightsofunityThe Knights of Unity·2y

    Database System in Unity using Resources and ScriptableObjects – The Knights of Unity

    Explore an efficient method to store and manage data in Unity using Resources and ScriptableObjects. This approach bridges the gap between developers and designers by allowing runtime data reading and easy data manipulation without additional plugins. It is particularly useful for RPG and multiplayer games, offering robust and simple data handling with dynamic loading from the Resources folder.

  4. 4
    Article
    Avatar of planetscalePlanetScale·2y

    Sharding strategies: directory-based, range-based, and hash-based

    Discover the different types of sharding strategies—directory-based, range-based, and hash-based—along with their pros and cons. Understand how solutions like Vitess and PlanetScale are making sharding more approachable, even though it remains a complex task. Learn how to choose the right sharding strategy based on your database needs while considering the potential challenges like uneven data distribution and added query complexity.

  5. 5
    Article
    Avatar of csharpcornerC# Corner·2y

    Soft Deletes with EF Core

    Soft deletes mark records as inactive without physically removing them from the database, allowing for data recovery, auditability, and logical deletion. This guide explains how to implement soft deletes in an EF Core application by defining a soft delete flag, updating the DbContext to apply global filters, handling soft delete operations, restoring soft-deleted records, and including soft-deleted records in queries when necessary.

  6. 6
    Video
    Avatar of primeagenThePrimeTime·2y

    I Will Dropkick You If You Use A Spreadsheet

    Spreadsheets, while often convenient, can lead to serious technical debt and inefficiencies when used in automated processes. Although they empower non-technical staff and provide quick fixes, their use in larger, scalable systems is highly discouraged. Alternatives like SQLite or more robust databases are recommended for lasting solutions. The post reflects on corporate anecdotes where the misuse of spreadsheets led to chaos, emphasizing the importance of proper data management tools.

  7. 7
    Article
    Avatar of devsquadDev Squad·2y

    MongoDB Essentials: What is MongoDB, Collections, and Documents?

    MongoDB is a NoSQL database that uses a flexible, document-oriented approach to store data instead of the traditional table-based structure. A collection in MongoDB groups together multiple documents and acts like a folder in a file system. Documents, the basic unit of data in MongoDB, are similar to records in a spreadsheet or JSON objects, containing various fields and values representing the data.

  8. 8
    Article
    Avatar of redislabsRedis·2y

    Semantic caching for faster, smarter LLM apps

    Semantic caching enhances data access speed and system intelligence by understanding user query semantics. Unlike traditional caching that stores data without context, this method allows for nuanced data interactions, leading to faster and more relevant responses. Optimizing data handling, semantic caching is crucial for GenAI apps, improving performance by reducing computational demands and accelerating response times. Redis is highlighted as a powerful tool for implementing efficient and real-time semantic caching.

  9. 9
    Article
    Avatar of ds_centralData Science Central·2y

    Reverse ETL in Healthcare- DataScienceCentral.com

    Managing patient data is a significant challenge in healthcare. Reverse ETL is a data integration method that ensures the smooth flow of data from data warehouses to operational systems like CRMs and ERPs. This real-time data synchronization improves patient care, enhances decision-making, maintains data consistency, ensures regulatory compliance, and enhances operational efficiency. Key components for successful implementation include a centralized data warehouse, robust ETL tools, seamless integration with operational systems, stringent data governance measures, and proper training for healthcare staff.

  10. 10
    Article
    Avatar of devsquadDev Squad·2y

    ACID Properties in Databases

    ACID properties (Atomicity, Consistency, Isolation, Durability) are principles used by databases to ensure correct and reliable transactions. Atomicity ensures transactions are all-or-nothing, Consistency ensures any transaction brings the database to a valid state, Isolation ensures transactions don't interfere with each other, and Durability ensures completed transactions are permanently recorded.

  11. 11
    Article
    Avatar of ds_centralData Science Central·2y

    Role of AI in Building Data Warehouses

    Leveraging AI in data warehousing offers multiple benefits including automation, enhanced efficiency, improved data quality, and optimization of the querying process. It aids in data integration, modification, and ETL processes while ensuring consistent and reliable data. AI enhances security by detecting unusual behaviors and helps in scaling the data warehouse seamlessly with cloud integration.

See all Data Management archives