Generative AI

 What is Generative AI?

Sub-field of AI that focuses on generating content such as text, images, audio, code, video, etc.

We use mathematical models to approximate the content. 




Basic Steps of Generative AI:

1) We use large data sets as inputs. For example, images or text

2) We feed the data to deep learning models to discern a pattern

3) We accomplish a task such as generating new images.


What is LLM?

advanced model that leverages Generative AI and is trained on large datasets to excel in language processing tasks.

How does LLM work?

There are 3 steps:

1) encoding - basically takes in text and converts them into tokens(numerical representations). The tokens with similar word meanings are also put "closer into vector space"



2) transforming - once it's done encoding, it is fed through a learning model. Sometimes a human is used in this step to guide the model.

3) decoding - converts the tokens back into human words.


How to build LLM Applications

Prices are coming down year over year.

You can use:

1) Open source - More flexible. All of the data and models are in your control. Expensive in-house labor, infrastructure , and data cost.

2) Proprietary - LLM as a service. Restrictions on usage and modification. This is basically another API call from a dev standpoint, so it is a lot easier to work with. Some of the downsides are cost, privacy issues, and being locked-in to a vendor.

Comments

Popular posts from this blog

Lifecycle of React components

Styled Components

e-commerce website built with React.nodejs