llm-sort

2025-02-11T20:50:21+00:00

Delightful LLM plugin by Evangelos Lamprou which adds the ability to perform "semantic search" - allowing you to sort the contents of a file based on using a prompt against an LLM to determine sort order.

Best illustrated by these examples from the README:

llm sort --query "Which names is more suitable for a pet monkey?" names.txt

cat titles.txt | llm sort --query "Which book should I read to cook better?"

It works using this pairwise prompt, which is executed multiple times using Python's sorted(documents, key=functools.cmp_to_key(compare_callback)) mechanism:

Given the query:
{query}

Compare the following two lines:

Line A:
{docA}

Line B:
{docB}

Which line is more relevant to the query? Please answer with "Line A" or "Line B".

From the lobste.rs comments, Cole Kurashige:

I'm not saying I'm prescient, but in The Before Times I did something similar with Mechanical Turk

This made me realize that so many of the patterns we were using against Mechanical Turk a decade+ ago can provide hints about potential ways to apply LLMs.

Via lobste.rs

Tags: mechanical-turk, plugins, python, ai, generative-ai, llms, llm

Cheap, Easy Audio Transcription with Mechanical Turk

2008-09-25T18:37:12+00:00

Cheap, Easy Audio Transcription with Mechanical Turk

Andy Baio’s in-depth tutorial on submitting HITs to Mechanical Turk. I hadn’t realised how straight forward and powerful the interface has become.

Tags: amazon, andy-baio, mechanical-turk, transcription

Simon Willison's Weblog: mechanical-turk

llm-sort

Cheap, Easy Audio Transcription with Mechanical Turk