http://simonwillison.net/2019-12-18T09:05:40+00:00Simon Willison2019-12-18T09:05:40+00:002019-12-18T09:05:40+00:00https://simonwillison.net/2019/Dec/18/athena-sqlite/#atom-tag

<p><strong><a href="https://github.com/dacort/athena-sqlite">athena-sqlite</a></strong></p> Amazon Athena is the AWS tool for querying data stored in S3—as CSV, JSON or Apache Parquet files—using SQL. It’s an interesting way of buliding a very cheap data warehouse on top of S3 without having to run any additional services. Athena recently added a query federation SDK which lets you define additional custom data sources using Lambda functions. Damon Cortesi used this to write a custom connector for SQLite, which lets you run queries against data stored in SQLite files that you have uploaded to S3. You can then run joins between that data and other Athena sources. <p><small></small>Via <a href="https://twitter.com/dacort/status/1206059672513306626">@dacort</a></small></p> <p>Tags: <a href="https://simonwillison.net/tags/athena">athena</a>, <a href="https://simonwillison.net/tags/aws">aws</a>, <a href="https://simonwillison.net/tags/s3">s3</a>, <a href="https://simonwillison.net/tags/sql">sql</a>, <a href="https://simonwillison.net/tags/sqlite">sqlite</a>, <a href="https://simonwillison.net/tags/parquet">parquet</a></p>

2019-03-15T16:03:48+00:002019-03-15T16:03:48+00:00https://simonwillison.net/2019/Mar/15/client-side-instrumentation-under-1-month-no-servers-necessary/#atom-tag

<p><strong><a href="https://bostata.com/post/client-side-instrumentation-for-under-one-dollar/">Client-side instrumentation for under $1 per month. No servers necessary.</a></strong></p> Rolling your own analytics used to be too complex and expensive to be worth the effort. Thanks to cloud technologies like Cloudfront, Athena, S3 and Lambda you can now inexpensively implement client-side analytics (via requests to a tracking pixel) that stores detailed logs on S3, then use Amazon Athena to run queries against those logs ($5/TB scanned) to get detailed reporting. This post also introduced me to Snowplow, an open source JavaScript analytics script (released by a commercial analytics platform) which looks very neat—it’s based on piwik.js, the tracker from the open-source Piwik analytics tool. <p><small></small>Via <a href="https://news.ycombinator.com/item?id=19388489">Hacker News</a></small></p> <p>Tags: <a href="https://simonwillison.net/tags/analytics">analytics</a>, <a href="https://simonwillison.net/tags/athena">athena</a>, <a href="https://simonwillison.net/tags/cloudfront">cloudfront</a>, <a href="https://simonwillison.net/tags/lambda">lambda</a>, <a href="https://simonwillison.net/tags/s3">s3</a></p>

2007-03-26T14:43:08+00:002007-03-26T14:43:08+00:00https://simonwillison.net/2007/Mar/26/athena/#atom-tag

<p><strong><a href="http://atlas-proj-computing-tdr.web.cern.ch/atlas-proj-computing-tdr/Html/Computing-TDR-21.htm">The Athena Framework</a></strong></p> CERN’s ATLAS particle accelerator experiment is scriptable with Python. <p>Tags: <a href="https://simonwillison.net/tags/athena">athena</a>, <a href="https://simonwillison.net/tags/atlas">atlas</a>, <a href="https://simonwillison.net/tags/cern">cern</a>, <a href="https://simonwillison.net/tags/particlephysics">particlephysics</a>, <a href="https://simonwillison.net/tags/python">python</a></p>