let me show you how you can take any API and use the new AI assistant within our connector Builder to create a custom API connector in literally minutes for this demo I'm going to be using the Polygon API it's got a pretty good API and with

our new AI assistant it's going to be pretty easy to plug in and create a connector with this so let's get going I've already created an account and I've got my API key so what I'm going to go ahead and do is go over to their

documentation and now that I'm on the documentation what I'm simply going to do is I'm just going to copy the URL here and switch back over to Airbyte now that I'm back into Airbyte let me go over to the left hand side on the

Builder tab going to click new custom connector start from scratch and then I'm going to name this I'm going to call this simply Polygon I'm going to paste the URL that I got and now down here on the First Data stream it's asking me

what endpoint I want to use first and so I'm simply going to use the ticker data stream now before I click create what the AI assistant is going to do is it's simply going to scrape the URL and plug in all the necessary information we need

on the connection Builder side to run and use a custom connector so let me go ahead and click create and now AI is going to do its thing it's going to scrape the documentation grab all the necessary information like I said and once we get back into the connector Builder we'll

see that we'll have the information that we need filled out so once the AI assistant is done scraping through the documentation you're brought back into the connector Builder what you'll see here at the top is it noticed what the base URL is as well as the type of

authentication needed in order to interact with the polygon API in this case we need a bearer token and on the top right here you can see that we can input a testing value which is going to be our API key and when you publish this connector it's going to be whoever

the users is they can put in their own API key in order to use this connector so let me go ahead and plug my API key in and click save now if you look to the bottom left here on the streams section there's the tickers endpoint that we

used at the beginning of this video and so if I click that the AI assistant has actually detected the correct URL path what kind of HTTP method it's listed a primary key as well as even gone into the records themselves and selected the correct field path we need to tap into

to get our results which is the results field path scroll down a little bit more and it added some pagination for us so it even detected the pagination we all know that pagination and APIs are pretty difficult to work with especially since they're always different so it actually

went through the documentation found that cursor pagination is the type of pagination that it uses put in the cursor values as well as the stop condition for us so we don't have to do any work right here in the Quest options I know that it didn't list anything here

but I know that there are query parameters available. Keep in mind the AI assistant is in beta, so it may not detect everything. Just keep in mind. Now for the query parameters, I'm simply just going to add a limit parameter, and I'm going to put a 100 because I don't want

every single ticker symbol to come back from this API. I just want to limit it to 100. Now that that's in place and we added our API key, let me go ahead and test this endpoint, and boom, you can see that I get back our records here. Let me

scroll down, down. You can see that we have every single value. Pagination comes through. We can click through on the request to see what the request itself looks like and what the actual JSON response is. We go to the left-hand side again on the streams. If I click the plus

sign and click this drop down, you'll notice that we have a couple other endpoints here, and this is because the AI assistant has actually detected all these other endpoints and can create new streams for us simply just by the information it got back. So what I'm

going to use is I'm going to use the news endpoint. I just want to add another one. Let me go ahead and click create. AI is going to do its thing, and now you'll notice the URL path has changed. We have a new primary key, the

field path remains the same since the endpoint always pretty much returns back in results array with the AI assistant. I don't have to read more of the documentation. It's already done the work for me, so it saves a huge amount of time. So if I go ahead and test this as well

and now in the records I get 10 records back within a page I can scroll through all the different pages with all the different news for different companies from the API so now that I'm in a good spot what I can go ahead and do is click

the publish button at the top right I'm going to do ignore warning since there are a couple things that I haven't done let me go ahead and confirm this and I can name my connector I can give it a description publish this to the workspace so that all my workspace

members can utilize this connector if this is something that I think I would want to contribute to the Airbyte catalog as a whole I can simply do that you'd have to test all your streams accordingly and make sure there are no warnings I'm going to go ahead and

publish this to my workspace just like that that if I exit the Builder go to sources click new source and go to custom we're going to see my Polygon connector is here plug in an API key and we're off to the races if you want to

try out the AI assistant for yourself you can sign up for Airbyte Cloud which the AI assistant is available for only for Cloud you can get a 14-day free trial right now so click the link below get using it let us know what you think

Can AI Really Create Data Pipelines in Minutes!?

Airbyte

소개 및 설정: 에어바이트의 AI 어시스턴트와 함께 폴리곤 API 사용하기

에어바이트의 AI 어시스턴트와 폴리곤 API를 사용하여 사용자 지정 API 커넥터를 만드는 방법을 시연합니다.

API 키 획득 및 Polygon API 문서에 액세스하는 방법을 보여줍니다.

Airbyte의 빌더 탭으로 이동하여 새 사용자 지정 커넥터를 생성합니다.

커넥터의 이름을 'Polygon'으로 지정하고 API URL을 붙여넣습니다.

URL을 스크랩하고 필요한 정보를 입력하는 AI 어시스턴트의 역할에 대해 설명합니다.

커넥터 생성을 자동화하는 AI 어시스턴트

AI 어시스턴트가 기본 URL, 인증 유형(무기명 토큰)을 식별하고 API 키 입력을 요청하는 메시지를 표시합니다.

자동으로 감지된 '티커' 엔드포인트와 해당 세부 정보를 표시합니다.

URL 경로, HTTP 방법, 기본 키 및 필드 경로에 대한 AI의 탐지 기능을 강조 표시합니다.

AI 어시스턴트가 페이지 매김을 자동으로 처리하여 유형을 식별하고 커서 값과 중지 조건을 설정합니다.

AI 어시스턴트가 베타 버전이기 때문에 쿼리 매개 변수(제한)를 수동으로 추가합니다.

테스트 및 추가 엔드포인트 추가

엔드포인트를 테스트하고 페이지 매김을 통해 성공적인 데이터 검색을 보여줍니다.

AI 어시스턴트가 다른 엔드포인트를 감지하여 새로운 스트림(예: '뉴스')을 쉽게 추가할 수 있습니다.

'뉴스' 엔드포인트를 추가하면 AI가 필요한 정보를 자동으로 입력합니다.

'뉴스' 엔드포인트를 테스트하여 성공적인 데이터 검색을 입증합니다.

커넥터를 워크스페이스에 게시하여 워크스페이스 멤버가 사용할 수 있도록 합니다.

에어바이트 카탈로그에 커넥터를 기여하는 옵션에 대해 설명합니다.

게시된 사용자 지정 커넥터에 액세스하고 사용하는 방법을 보여줍니다.

콜 투 액션: 에어바이트 클라우드에 가입하여 AI 어시스턴트를 사용해 보세요.

Can AI Really Create Data Pipelines in Minutes!?

Can AI Really Create Data Pipelines in Minutes!?

스크립트