Data, Databases & Streaming

Relational & NoSQL databases, search, caches, streams, ETL/ELT, and analytics stacks.

  • 7 Subtopics
  • 15 Tracked terms
  • Last 30 days Feed window
Search within this topic Ask AI about this topic All topics

Inside Data, Databases & Streaming

Relational (SQL) Postgres/MySQL/SQLite tuning, HA/DR, indexing, and query planning. NoSQL & NewSQL Document, key-value, columnar, search, and distributed SQL engines. Search & Relevance Engineering Full-text search, ranking, synonyms, vectors, and hybrid retrieval patterns. Caching & Edge Data KV stores, CDNs, edge runtimes, and latency-first data patterns. Streaming & Queues Event streaming, pub/sub, backpressure, and consumer groups at scale. ORMs & Migrations Type-safe models, schema diffs, seed data, and multi-tenant strategies. Data Engineering & Analytics Pipelines, orchestration, dbt, warehouses, BI, and governance/lineage.

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

Latest in Data, Databases & Streaming

@hackernoon
hackernoon.com > whose-memory-is-it-building-multi-tenant-multi-tier-memory-for-ai-agents-part-4

Whose Memory Is It? Building Multi-Tenant, Multi-Tier Memory for AI Agents (Part 4)

19+ hour, 20+ min ago   (1782+ words) This is a 4-part series on how agents remember:building short-, medium- and long-term memory thatscales across users, agents, and kubernetes clusters. Alice and Bob both use our agent platform. On Monday, Alice worked on a support incident, and the…...

Medium
medium.com > @arpita.mishra0303 > moving-away-from-s3-athena-why-we-migrated-our-analytics-pipeline-to-postgresql-d96782ed21d6

Moving Away from S3 & Athena: Why We Migrated Our Analytics Pipeline to PostgreSQL

4+ hour, 44+ min ago   (29+ words) A real-world look at architecture redesign, ingestion layers, and performance wins in a Food-Tech SaaS …...

Open Source For You
opensourceforu.com > 2026 > 09 > vector-databases-explained-powering-ai-with-open-source-data-storage

Vector Databases Explained: Powering AI with Open Source Data Storage

1+ week, 2+ day ago   (1717+ words) What do vector databases do? Why did they show up when they did? Which open source ones are worth your time? How do you use them? Here are some answers… It was a fair question. And I realised I’d never…...

DEV Community
dev.to > ms_njenga > sql-is-surviving-franklin-when-one-query-isnt-enough-20ld

SQL Is Surviving, Franklin: When One Query Isn't Enough

9+ hour, 38+ min ago   (1774+ words) Franklin survived SQL JOINs. Last time, we made tables talk to each other. We connected students to classes, classes to teachers, and somehow convinced Franklin that duplicate rows were not a database malfunction. He was beginning to feel confident. "Which…...

DEV Community
dev.to > darkpandawarrior > one-global-threshold-is-how-you-delete-valid-data-303h

One global threshold is how you delete valid data

10+ hour, 24+ min ago   (388+ words) Our GPS filter worked perfectly, right up until someone sat in Bangalore traffic. A parked phone does not sit still in the data. The reported position wanders a few metres in every direction, and if you naively sum the gaps…...

DEV Community
dev.to > shane11235 > turning-mermaid-er-diagrams-into-shareable-3d-schema-tours-nn8

Turning Mermaid ER diagrams into shareable 3D schema tours

10+ hour, 41+ min ago   (20+ words) Mermaid erDiagram is great for... Tagged with mermaid, sql, database, opensource....

Medium
medium.com > @techybob > 5-explain-analyze-patterns-every-data-engineer-should-know-8a454ec1ce03

5 EXPLAIN ANALYZE Patterns Every Data Engineer Should Know

7+ hour, 26+ min ago   (180+ words) If you’ve stared at PostgreSQL’s EXPLAIN ANALYZE output and felt completely lost, you're not alone. A few months ago, I spent nearly three hours debugging a query that looked perfectly reasonable in code review but turned into a 15-second nightmare…...

DEV Community
dev.to > jeromefromhk > migrated-up-then-back-3j10

Migrated Up, Then Back

12+ hour, 5+ min ago   (407+ words) The promise I'd made myself at the start was the discipline that kept the migration honest: external domains and ports stay unchanged, and the reverse proxy stays the anchor. Move a service in, get it working on k3s, then repoint the…...

DEV Community
dev.to > mech_app_ai > agent-cache-multi-tier-llm-caching-for-valkey-and-redis-10kf

Agent-Cache: Multi-Tier LLM Caching for Valkey and Redis

14+ hour, 12+ min ago   (666+ words) Agent loops burn tokens and clock cycles on repeated work. The same LLM prompt fires twice, the same tool call fetches identical data, and session state gets reconstructed from scratch on every request. Agent-cache solves this with a three-tier caching…...

DEV Community
dev.to > j_sakamoto > no-server-no-backend-just-blazor-webassembly-doing-semantic-search-bl4

No Server, No Backend, Just Blazor WebAssembly Doing Semantic Search

14+ hour, 29+ min ago   (1050+ words) 🚀 Semantic search on GitHub Pages with zero backend I recently added semantic search to... Tagged with blazor, webdev, embedding, dotnet....