Best of Real-Time Analytics — 2024

  1. 1
    Article
    Avatar of tinybirdTinybird·2y

    Tinybird vs. ClickHouse

    ClickHouse is an open-source columnar database ideal for real-time analytics, while Tinybird is a data platform built on ClickHouse that simplifies management and speeds up deployment. Tinybird offers out-of-the-box tuning, API generation, and native connectors, reducing the need for deep expertise and infrastructure management. ClickHouse allows for more granular control and tuning, appealing to those willing to manage their own infrastructure. Both provide robust performance, but Tinybird is designed to minimize setup efforts and accelerate time to production.

  2. 2
    Article
    Avatar of itnextITNEXT·2y

    Streaming Architecture in AWS to capture tweets in near real time

    This post describes a streaming architecture using AWS to capture tweets in near real time. It outlines how to use the Twitter Streaming API to collect tweets with specific keywords, Dockerized Tweet capture application on an AWS EC2 instance, and AWS services like Kinesis Firehose, S3, IAM roles, CloudWatch, Lambda functions, MySQL DB, and OpenSearch. The architecture was adjusted to include Amazon Simple Queue Service (SQS) for better handling of Lambda function triggers.

  3. 3
    Article
    Avatar of towardsdevTowards Dev·2y

    What Is a Streaming Database?

    A streaming database is designed to process large amounts of real-time streaming data, providing real-time insights and analysis. It is ideal for latency-critical applications such as real-time analytics, fraud detection, network monitoring, and the Internet of Things (IoT). Streaming databases differ from traditional databases in their processing approach and can be used alongside other data systems for streaming ingestion and streaming analytics. They also differ from OLTP and OLAP databases in terms of ACID compliance, data correctness, and query optimization.

  4. 4
    Article
    Avatar of tinybirdTinybird·2y

    3 ways to run real-time analytics on AWS with DynamoDB

    Amazon DynamoDB is optimized for real-time transactional uses but falls short for analytical workloads. This post covers three ways to extend DynamoDB for real-time analytics by integrating it with other AWS technologies like Lambda, ElastiCache for Redis, and Tinybird. It explains how each approach works, including their pros and cons, for generating low-latency aggregated data for user-facing applications.

  5. 5
    Article
    Avatar of baeldungBaeldung·2y

    Introduction to Apache Pinot

    Apache Pinot is a real-time distributed OLAP datastore designed for low latency and high throughput analytical queries. It supports real-time and batch data ingestion, offers low latency queries, and can scale horizontally. The architecture includes components like the cluster, controller, broker, server, minion, tenant, and segments. Installation can be done via Docker. Apache Pinot is a top choice for businesses in need of real-time analytics.

  6. 6
    Article
    Avatar of singlestoreSingleStore·2y

    Designing a Real-Time Data Warehouse

    In the era of data-driven applications, real-time data warehouses (RTDW) are crucial for enabling low-latency analytical queries on fresh data. Unlike traditional data warehouses, RTDWs support continuous data ingestion and high concurrency, making them essential for applications like fraud detection and market analysis that require immediate insights. SingleStore offers a robust RTDW solution with real-time data ingestion, low-latency processing, high-concurrency support, scalability, and seamless integration, delivering real-time analytics at scale.

  7. 7
    Article
    Avatar of phplibPHP LibHunt·2y

    Awesome PHP Weekly - Issue 431, Aug 22, 2024

    A weekly overview featuring popular PHP news, articles, and libraries. Highlights include discussions on Generics, Collections, and faster GitHub Actions with Blacksmith. Also mentioned are various PHP libraries like EspoCRM and tools for real-time data analytics using InfluxDB.

  8. 8
    Article
    Avatar of detlifeData Engineer Things·1y

    The Ultimate Guide to Zero ETL: Real-Time Insights, Benefits, Challenges, and Best Practices

    Zero ETL (Extract, Transform, Load) is a data processing technique that minimizes or eliminates traditional ETL workflows by enabling real-time data access and analysis. It offers benefits like reduced latency, lower complexity, increased flexibility, and scalability. However, it also presents challenges, including data governance and compliance risks, complex data integration, and potential vendor lock-in. Zero ETL is ideal for use cases such as real-time analytics in e-commerce, data-driven marketing campaigns, IoT and sensor data integration, and fraud detection in financial services. Best practices involve robust monitoring, implementing security measures, and maintaining clear communication about data changes.

  9. 9
    Article
    Avatar of phProduct Hunt·1y

    WP Monitor - Real-Time Analytics for WordPress Plugins and Themes

    WP Monitor offers real-time analytics for WordPress plugins and themes. Launched on October 16th, 2024, it is designed to provide developers with insights into the performance of their WordPress components.

See all Real-Time Analytics archives