Connect Screaming Frog with OpenAI

[samiaseo55]

If everything is in order and Screaming Frog has extracted your reviews, you can go one step further and upload them to OpenAI, which will then allow ChatGPT to analyze the texts and create captions from them.

First, however, you need to ensure that Screaming Frog can cache HTML.

Go to Configuration > Spider > Extraction and check if teacher data you have both HTML items checked in the list, i.e. Store HTML and Store Rendered.

Next, set up Screaming Frog to connect to OpenAI artificial intelligence . You will need the generated OpenAI API key to do this.

Once you receive it, go to Configuration > API Access > AI > OpenAI and enter your key there.

Enter the challenge
On the Challenge Configuration tab , click Add and name the new challenge Product Labels. In the Page Text drop-down list, select Custom Extraction > Reviews . This allows Screaming Frog to send the extracted text to OpenAI.

In the Enter a prompt field , type your prompt. The format is entirely up to you, but it could look something like this: “Below are all the reviews of a specific product from my website. Please use them to write a description of this product.”

Once you've entered the prompt, test the resulting output by clicking the Play button next to the prompt. This will open the Open AI Prompt Tester and you can read the resulting text as you insert the sample page.