Simon Willison's Weblog: anton-zhiyanov

High-precision date/time in SQLite

2024-08-09T15:31:40+00:00

Another neat SQLite extension from Anton Zhiyanov. sqlean-time (C source code here) implements high-precision time and date functions for SQLite, modeled after the design used by Go.

A time is stored as a 64 bit signed integer seconds 0001-01-01 00:00:00 UTC - signed so you can represent dates in the past using a negative number - plus a 32 bit integer of nanoseconds - combined into a a 13 byte internal representation that can be stored in a BLOB column.

A duration uses a 64-bit number of nanoseconds, representing values up to roughly 290 years.

Anton includes dozens of functions for parsing, displaying, truncating, extracting fields and converting to and from Unix timestamps.

Via lobste.rs

Tags: datetime, go, sqlite, anton-zhiyanov

Modern SQLite: Generated columns

2024-05-08T16:55:41+00:00

Modern SQLite: Generated columns

The second in Anton Zhiyanov's series on SQLite features you might have missed.

It turns out I had an incorrect mental model of generated columns. In SQLite these can be "virtual" or "stored" (written to disk along with the rest of the table, a bit like a materialized view). Anton noted that "stored are rarely used in practice", which surprised me because I thought that storing them was necessary for them to participate in indexes.

It turns out that's not the case. Anton's example here shows a generated column providing indexed access to a value stored inside a JSON key:

create table events (
  id integer primary key,
  event blob,
  etime text as (event ->> 'time'),
  etype text as (event ->> 'type')
);
create index events_time on events(etime);
insert into events(event) values (
  '{"time": "2024-05-01", "type": "credit"}'
);

Update: snej reminded me that this isn't a new capability either: SQLite has been able to create indexes on expressions for years.

Via lobste.rs

Tags: sqlite, anton-zhiyanov

redka

2024-04-14T15:21:19+00:00

redka

Anton Zhiyanov’s new project to build a subset of Redis (including protocol support) using Go and SQLite. Also works as a Go library.

The guts of the SQL implementation are in the internal/sqlx folder.

Via @ohmypy

Tags: go, redis, sqlite, anton-zhiyanov

SQLite 3.44: Interactive release notes

2023-11-01T15:47:20+00:00

SQLite 3.44: Interactive release notes

Anton Zhiyanov compiled interactive release notes for the new release of SQLite, demonstrating several of the new features. I’m most excited about order by in aggregates—group_concat(name order by name desc)—which is something I’ve wanted in the past. Anton demonstrates how it works with JSON aggregate functions as well. The new date formatting options look useful as well.

Tags: sqlite, anton-zhiyanov

sqlean.py: Python's sqlite3 with extensions

2023-06-17T22:42:13+00:00

sqlean.py: Python's sqlite3 with extensions

Anton Zhiyanov built a new Python package which bundles a fresh, compiled copy of SQLite with his SQLean family of C extensions built right in. Installing it gets you the latest SQLite—3.42.0—with nearly 200 additional functions, including things like define() and eval(), fileio_read() and fileio_write(), percentile_95() and uuid4() and many more. “import sqlean as sqlite3” works as a drop-in replacement for the module from the standard library.

Tags: python, sqlite, anton-zhiyanov

SQLime: SQLite Playground

2022-01-17T19:08:12+00:00

SQLime: SQLite Playground

Anton Zhiyanov built this useful mobile-friendly online playground for trying things out it SQLite. It uses the sql.js library which compiles SQLite to WebAssembly, so it runs everything in the browser—but it also supports saving your work to Gists via the GitHub API. The JavaScript source code is fun to read: the site doesn’t use npm or Webpack or similar, opting instead to implement everything library-free using modern JavaScript modules and Web Components.

Via Anton Zhiyanov

Tags: javascript, sqlite, web-components, webassembly, anton-zhiyanov

sqlite-plus

2021-03-25T21:13:33+00:00

sqlite-plus

Anton Zhiyanov bundled together a bunch of useful SQLite C extensions for things like statistical functions, unicode string normalization and handling CSV files as virtual tables. The GitHub Actions workflow here is a particularly useful example of compiling SQLite extensions for three different platforms.

Via SQLite is not a toy database

Tags: sqlite, github-actions, anton-zhiyanov