Hacker Newsnew | past | comments | ask | show | jobs | submit | fahimulhaq's commentslogin

Hey Adil, Thanks for sharing and congratulations on launch.

Can I just use arch for routing between LLMs? And what LLMs do you support? And what about key management? Do I manage access keys myself?


Thanks! Those are all good questions. Let me respond to them one by one,

> Can I just use arch for routing between LLMs

Yes, you can use arch_config.yaml file to select between LLMs. In fact we have a demo on llm_routing [1] that you can try. Here how you can specify different LLMs in our config,

  llm_providers:
    - name: gpt-4o-mini
      access_key: $OPENAI_API_KEY
      provider: openai
      model: gpt-4o-mini
      default: true

    - name: gpt-3.5-turbo-0125
      access_key: $OPENAI_API_KEY
      provider: openai
      model: gpt-3.5-turbo-0125

    - name: gpt-4o
      access_key: $OPENAI_API_KEY
      provider: openai
      model: gpt-4o

    - name: ministral-3b
      access_key: $MISTRAL_API_KEY
      provider: mistral
      model: ministral-3b-latest


> And what LLMs do you support

We currently support mistral and openai. And for both of them we support streaming interface. We do expose openai complaint v1/chat interface so any chat UI that works with openai should work with us as well. We do ship demos with gradio sample application.

> And what about key management? Do I manage access keys myself?

None of your clients need to manage access keys. Upon receipt of request our filter will appropriate LLM from arch_config and pick relevant access_key and modify request with access_key from arch_config before sending request to upstream LLM [2].

[1] https://github.com/katanemo/archgw/tree/main/demos/llm_routi...

[2] https://github.com/katanemo/archgw/blob/main/crates/llm_gate...


Educative | Bellevue, WA | Part-Time | Contract | AWS | Azure | Software Engineers, Coding Instructors, Machine Learning, Data Science, Web Development | REMOTE | https://www.educative.io

Educative is a text-based interactive learning platform for software engineers that provides pre-configured developer environments. Instructors create text-based lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc., without installing anything on their machines.

We are looking for experts in the following domains: Cyber Security, Blockchain, Mobile Apps, AWS, Azure, GCP, Machine Learning - Data Science and Web Development(Node, React, Vue, Angular, Typescript, etc.)

We are also looking for courses on topics that help engineers grow further, e.g., designing large-scale applications, security, compliance, code reviews, engineering management, etc.

If you want to write on a relevant topic to software engineers, we should talk.

We work with anyone with expertise related to software engineering and with a knack for writing, software engineers, Bootcamp instructors, university professors, and students who have taken advanced CS courses.

Contact us at authors {at} educative.io.


Educative | Bellevue, WA | Part-Time | Contract | AWS | Azure | Coding Instructors, Machine Learning, Data Science Web Development | REMOTE | https://www.educative.io

Educative is an interactive learning platform for software engineers that provides pre-configured developer environments. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are looking for experts in the following domains:

AWS, Azure, GCP, Machine Learning - Data Science - Web Development(Node, React, Vue, Angular, Typescript, etc.)

We are also looking for courses on topics that help engineers grow further e.g. designing large scale applications, security, compliance, code-reviews, etc.

If you can want to write on a topic that's relevant to software engineers, we should talk.

We work with engineers/instructors with a knack for writing, Bootcamp instructors, university professors, and students who have taken advanced CS courses.

Contact me at fahim {at} educative.io.


Educative | Seattle, WA | Full Time | Developer Adcovate | Developer Evangelist | https://www.educative.io

Educative is an interactive learning platform for software engineers that provides pre-configured developer environments. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are hiring for following two roles in Seattle, WA.

- Developer Evangelist And Content Lead You'll be working with the technical evangelists and marketing teams to create a strategy to build our author community. You'll also be responsible for sourcing new authors, identifying trends in software engineering, understanding new topics relevant to developers and then working on finding the domain experts in those areas, represent Educative at conferences and meetups, etc.

- Head of Developer Relations, Community & Content You will report directly to the CEO and work closely with technical evangelists, and marketing teams to create a strategy answering questions like how to build and nurture a developer community, how to attract great instructors to Educative, represent Educative at conferences and meetups, etc.

Please send your resumes to fahim {at} educative.io.


Educative | Seattle, WA | Full Time | Developer Adcovate | Developer Evangelist | https://www.educative.io

Educative is an interactive learning platform for software engineers that provides pre-configured developer environments. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are hiring for following two roles in Seattle, WA.

- Developer Evangelist And Content Lead You'll be working with the technical evangelists and marketing teams to create a strategy to build our author community. You'll also be responsible for sourcing new authors, identifying trends in software engineering, understanding new topics relevant to developers and then working on finding the domain experts in those areas, represent Educative at conferences and meetups, etc.

- Head of Developer Relations, Community & Content You will report directly to the CEO and work closely with technical evangelists, and marketing teams to create a strategy answering questions like how to build and nurture a developer community, how to attract great instructors to Educative, represent Educative at conferences and meetups, etc.

Please send your resumes to jobs {at} educative.io.


It's probably because Stripe didn't go through the traditional YC program.

"What’s interesting is that unlike 99% of YC companies, Stripe didn’t actually go through the standard startup bootcamp process. Patrick had already been through it once and didn’t feel the need to do it again. The amount YC invested was in the $20k-$30k range." [1]

[1]: https://www.startupgrind.com/blog/the-collison-brothers-and-...


Interesting. I didn't realize that was the case. Makes sense and thanks for the additional context.


https://www.educative.io/d/InterviewPrep has courses to brush up on DS/Algorithms and problems to practice coding interviews.


Educative | Techstars Seattle ‘18 | Seattle, WA | Part-Time | Contract | Computer Science Instructor, Machine Learning Instructor, Data Science Instructor, Block Chain Instructor, Web Development Instructor | REMOTE | https://www.educative.io

Educative is an interactive learning platform for software engineers that provides pre-configured developer environments. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are looking for experts in the following domains:

Blockchain/Bitcoin/Ethereum, - Machine Learning - Data Science - Web Development(React, Vue, Angular, MobX, Typescript, etc.) - Software and Web Testing - Software Patterns

If you can want to write on a topic that's relevant to software engineers, we should talk. All jobs are contract based.

We work with engineers/instructors with a knack for writing tutorials, bootcamp instructors, university professors and students who have taken advanced CS courses.

Contact me at fahim {at} educative.io.


Educative | Techstars Seattle ‘18 | Seattle, WA | Part-Time | Contract | Computer Science Instructor, Machine Learning Instructor, Data Science Instructor, Web Development Instructor | REMOTE | https://www.educative.io

Educative is an interactive learning platform for software engineers. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are looking for experts in - Blockchain/Bitcoin/Ethereum, - Machine Learning - Data Science - Web Development(React, Vue, Angular, MobX, Typescript, etc.) - Programming (C++, C#, Java, Go) - Computer Science (DS & Algo)

If you can want to write on a topic that's relevant to software engineers, we should talk. All jobs are contract based.

We work with engineers/instructors with a knack for writing tutorials, bootcamp instructors, university professors and students who have taken advanced CS courses.

Contact me at fahim {at} educative.io.


Educative | Techstars Seattle ‘18 | Seattle, WA | Part-Time | Contract | Computer Science Instructor, Machine Learning Instructor, Data Science Instructor, Web Development Instructor | REMOTE | https://www.educative.io

Educative is an interactive learning platform for software engineers. Instructors create lessons using Educative's course builder. Students learn using coding playgrounds, embedded web applications, coding challenges, etc. without the need to install anything on their machines.

We are looking for experts in Computer Science (DS & Algo), Programming (C++, C#, Java, Go), Web Development(React, Vue, Angular, MobX, Typescript etc.), Machine Learning, Data Science and Blockchain/Bitcoin/Ethereum.

If you can want to write on a topic that's relevant to software engineers, we should talk. All jobs are contract based.

We work with engineers with a knack for writing tutorials, bootcamp instructors, university professors and students who have taken advanced CS courses.

Contact me at fahim {at} educative.io.


Ooh, I can vouch for this! :)

If you haven't seen their platform, Fahim & co have created a seriously next-generation course-creation / hands-on-coding toolkit. & in my experience they've been super friendly, generous and given great advice.

Don't hesitate to contact them if you're interested in online teaching!


Hi Brian, thanks a lot for kind words (and good to hear from you. It's been a while).


Hi Fahim, REMOTE outside US is possible ?


Yes, absolutely.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: