• When using ChatGPT to create content, each session can handle 4,000 tokens, which is roughly around 3,000 , words total.
    What this means is that each word is converted into a legible token whenever a question is asked. To break it down further, tokens are text fragments.
    The 4000 tokens are a sum of the original prompt, original response and any content generated during the session.
  • A new chat session will automatically start when: 
    • The token limit is reached, an alert will pop up to notify you
    • The web page is reloaded
  • The integration is programmed to return responses that do not exceed 750 tokens. If the response is "cut off" because the 750 response limit has been reached, ask the AI to continue and the content can be completed. But after the 4,000 token limit has been reached in a session, ChatGPT's memory will reset and a new chat session will begin; it will not recall previous chat inputs.

Limitations

The ChatGPT API includes some limitations, but Brilliant Directories has configured it for maximum output. The ability for ChaptGPT to recall and remember previous inputs and outputs is limited to about 3,000 words and/or characters.

Although this limits the API’s ability to output a 2,000 word article in one shot, it is proven to provide a helping hand with creating snippets of content in real-time.

After this limit is reached, an alert will display and the next input will start a fresh chat session with ChatGPT.

There are 3 limits that can be reached:

  1. Session tokens reached, next input will start a new chat session (old chat session memory is gone):
  2. Max. Input requests per minute reached. Wait a few seconds before sending the next input request:
  3. Total monthly usage limit reached. Users can see their monthly usage in the Openai account settings. Upgrading to a pay-as-you-go plan increases this monthly limit, but it’s still capped.
    Here's where users can see their monthly usage limits:
    https://platform.openai.com/account/usage

For additional assistance:
Email support@brilliantdirectories.com or create a ticket Inside Your Account Dashboard.

Was this article helpful and accurate? Yes No