Ask HN: Is prompt engineering just snake oil?
24 by wg0 | 15 comments on Hacker News. Is prompt engineering a snake oil? The engineering, as the word stands so far in history is about observing clear limitations and capabilities of something and then "engineering" things around it such as "engineering a compiler" is all about knowing the underlying processor, memory and other characteristics and then engineering a solution that converts a text notation to a stream of instructions that try to strike a balanced tradeoff. But with LLMs, no one knows their workings once they are trained. The other day, Bark model[0] for text to speech, the team itself has following to say on details: > Below is a list of some known non-speech sounds, but we are finding more every day. Please let us know if you find patterns that work particularly well on Discord! [laughter], [laughs], [sighs].... So that's the team themselves not knowing what their model is capable of then how come prompt engineering is any engineering at all? [0] https://ift.tt/jck2J9G
Show HN: We built a ClickHouse-based logging service
18 by vadman97 | 7 comments on Hacker News. Hey hn! I'm one of the co-founders of highlight.io, an open source monitoring tool. Today we're sharing a ClickHouse-based logging solution we've been working on. We wanted to showcase how we built it and share how you could try it out to give feedback. Since we started working on highlight.io, we've been hyper-focused on "cohesion", or ensuring that when you install your monitoring stack, all of the resources in that stack (user interactions, requests, traces, logs, etc.) are connected in a consumable way. We've written up more about our philosophy on this here [1]. We started building towards this by connecting your client-side app and your server-side exceptions with session replay and exception monitoring; i.e. if an error happened in a server-side app, we would make it easy (with session replay) to trace all the steps that a user took leading up to it. Especially for larger companies using highlight.io, the request to tie in logs came up repeatedly, and we wanted to build this with the same philosophy in mind. Now, you'll see client-side and server-side logs all in one place, brought together in the context of a user session, as well as logs in the context of an error. Like the rest of our stack, this project is written in Go and Typescript, and for log ingestion/querying, we're using ClickHouse [2]. Before deciding on ClickHouse, we were planning to use OpenSearch (an aws fork of elasticsearch [3]) for this part of our product, but as our traffic has increased, we encountered quite a few pains with write throughput for OpenSearch. After evaluating a few options, we eventually landed with ClickHouse (their cloud offering was icing on the cake), which has also proven to be much more cost-effective so far. Building with ClickHouse from scratch has been an exciting journey. Eric (the mastermind behind this project) wrote a blog post [4] on a handful of ClickHouse learnings we've gathered since starting the project. For those wanting to try out the product locally, you can run the following commands [5]: git clone --recurse-submodules https://ift.tt/zQo5Jwx cd highlight/docker; ./run-hobby.sh; To send logs to highlight, you can use your own OpenTelemetry implementation [6] or use our SDKs [7] which provide lightweight wrappers over OTEL. Like the rest of highlight.io, we plan to make money from this with our hosted cloud offering. For those interested in trying out the cloud-hosted version, you can get setup at app.highlight.io. To open the floor for feedback, we would love to get some thoughts on what we've built so far. Beyond that, what are parts of a logging product you wish you had with your current setup? And are there any notable pain-points of using a hosted monitoring product? (We're toying with the idea of an enterprise deployment). Excited to hear from everyone. [1]: https://ift.tt/kA90ouC [2]: https://clickhouse.com [3]: https://ift.tt/pAjosX6 [4]: https://ift.tt/MtDYnlj... [5]: https://ift.tt/W89LCRb... [6]: https://ift.tt/7PEeZli... [7]: https://ift.tt/QCbzjFx...
Tell HN: Eid Mubarak
154 by asim | 24 comments on Hacker News. To the Muslims on HN, Eid Mubarak! And to everyone else, Eid Mubarak! For those who don't know. Eid is a day of celebration after the month of Ramadan, in which Muslims fasted for 30 days from sunrise to sunset with no food or water. It's something 2B people around the world celebrate to today or tomorrow (moon sighting permitted). A note on Ramadan. To those interested in intermittent fasting, longevity, and coming back to a more human experience not drowning in technology, food and consumerism I would say check it out! After over 20 years of doing it I'm still learning something new every year, or I should say, unlearning bad habits we've created for ourselves as a society through abundance. Hope you all have a great day!