I've been tracking this as well [1], and there's indeed a clear difference between pre-2023 and 2023 onward.

[1] https://hnjobs.mathieularose.com

Unsurprisingly, the "Who's Hiring" almost perfectly tracks the "Software Development Job Postings on Indeed in the United States" data from the fed, though it doesn't go as far back.

https://fred.stlouisfed.org/series/IHLIDXUSTPSOFTDEVE

Most other industries follow a similar trend, but didn't fly quite as high in 2022 and aren't in as bad of a trough right now.

Electrical Engineering: https://fred.stlouisfed.org/series/IHLIDXDETPELECENGI (actually up slightly)

Accounting: https://fred.stlouisfed.org/series/IHLIDXUSTPACCO (more seasonal noise)

Marketing: https://fred.stlouisfed.org/series/IHLIDXUSTPMARK

Yours looks much nicer!

lowest amount yet

Regarding the HN to sqlite part, I'm writing a "syncer" that continuously updates data from HN to a local sqlite database. Its goal is to enable anyone to have a local copy of the HN dataset to build various projects (like yours) on top of it. I'm about to release it as an open-source project and would love to collaborate to make sure it supports your use case. I couldn't find an email address in your profile, so please reach out if you're interested.

Not LLM-based, but I built https://hn.lixiasearch.com . Feel free to use it as a comparison point :)

Oops, that's just bad writing from me. Should be clearer now that they aren't cancelling each other. Thanks!

Same! You may enjoy "Everyday Engineering: Understanding the Marvels of Daily Life" from The Great Courses [0]. It's free on Kanopy through many libraries.

[0]: https://www.thegreatcourses.com/courses/everyday-engineering...

I use Oak Backup (https://www.oakbackup.com) and backup to S3.

Indeed. And you don't even need to create a PR to "inject" commits into a GitHub repo. You just need to fork it and push to your fork. See https://mathieularose.com/github-commit-injection

Your problem is a scheduling problem. It has been well studied in operations research [1] / mathematical optimization [2].

Basically, you formulate your problem as a integer programming model [3] and use a solver [4] to solve it. You should check PuLP [5].

You can also ask your question at OR Exchange [6].

[1] https://en.wikipedia.org/wiki/Operations_research

[2] https://en.wikipedia.org/wiki/Mathematical_optimization

[3] https://en.wikipedia.org/wiki/Integer_programming

[4] https://en.wikipedia.org/wiki/List_of_optimization_software

[5] https://pythonhosted.org/PuLP/

[6] https://www.or-exchange.org/

After this, do a bit of research on goal programming or other approaches to multiobjective optimization. It could really help and depending on the approach, it's not that hard. It usually just adds a bunch of constraints or some precompuations to an already existing set of in/equalities for your model.

ALLOCATING CONFERENCE DELEGATES TO WORKSHOPS: A SPECIAL TIMETABLING PROBLEM -- "The problem of assigning delegates to workshops at a conference can be formulated as a timetabling problem. Such an assignment must take into account the preferences of the delegates, as well as the number of participants each workshop can accommodate. This paper will report on a heuristic solution technique for a special case of such a problem."

http://orion.journals.ac.za/pub/article/view/470

Thank you for the detailed response!

I use https://attomon.com (disclaimer: I'm the creator)

I'm also interested in hearing what you like and don't like about your current website monitoring solution.

https://attomon.com - Website monitoring

https://maitreinvestisseur.ca (French) - Why and how to invest using low-cost index funds.