(Claude) Request fails with "all messages must have non-empty content"

[agzam]

I set gptel-default-mode to org-mode and at first, it seemed that it's worked, but it sometimes can fail.

What I did:

• Set gptel-default-mode to org-mode
• Opened gptel buffer, started using it normally
• at some point it fails with:

Claude error: (HTTP/2 400) messages.2: all messages must have non-empty content except for the optional final assistant message

[karthink]

Ah yeah, I'm aware of this issue. It's unrelated to Org mode. See prior discussions in #406, #321, #351, #343.

There is no easy fix for this yet. Rather, there are several easy ways to fix it but all of them create new problems. Here are three independent things you can do to avoid the error (i.e., any one of them will work, don't do them all):

1. Don't modify Claude's response in any way, either using gptel-post-request-functions or manually. (Obviously this is not an acceptable compromise.)
2. Switch to the feature-overlays branch of gptel.
3. Run

(setf (alist-get 'gptel 'text-property-default-nonsticky nil 'remove) nil)

Each of these causes other problems, but it's possible you may not encounter any of them.

Eventually I need to find a solution that works with minimal compromises.

[agzam]

It's unrelated to Org mode

For some reason I don't see it (at least not as often) when using Markdown mode.

[wlauppe]

when i looked at the code after a recent "invalid_request_error" I realized, that my buffer had adjacent GPTEL_BOUNDS
shoudnt it just merge:
:GPTEL_BOUNDS: ((359 . 835) (836 . 2720) (2721 . 3388))
to
:GPTEL_BOUNDS: ((359 . 2720) (2721 . 3388))
and then there would be no empty user message? Would this be a solution?

[wlauppe]

I got the feeling, that gptel sometimes produces these invalid_request_error-hickups even if you dont edit the response. For debugging purposes i wrote some functions, which visually show the gptel-bounds:

;; gptel chat coloring 
(defvar gptel-bounds-overlay nil
  "Variable to store the overlay for GPTEL_BOUNDS.")

(defun show-and-highlight-gptel-bounds ()
  "Display the first occurrence of GPTEL_BOUNDS property in the file and highlight the bounds."
  (interactive)
  (save-excursion
    (goto-char (point-min))
    (let ((bounds-str (org-entry-get (point) "GPTEL_BOUNDS")))
      (if bounds-str
          (let ((bounds (read bounds-str)))
            (message "GPTEL_BOUNDS: %s" bounds-str)
            (highlight-bounds bounds))
        (message "No GPTEL_BOUNDS property found in the file.")))))

(defun highlight-bounds (bounds-list)
  "Highlight the regions specified by BOUNDS-LIST."
  (dolist (range bounds-list)
    (let ((start (car range))
          (end (cdr range)))
      (when (and (numberp start) (numberp end) (<= start end))
        (let ((overlay (make-overlay start end)))
          (overlay-put overlay 'face '(:background "light sky blue"))
          (overlay-put (make-overlay start (1+ start)) 'face '(:background "steel blue"))
          (overlay-put (make-overlay (1- end) end) 'face '(:background "steel blue"))
          (push overlay gptel-bounds-overlay))))))

(defun toggle-highlight-gptel-bounds ()
  "Toggle the highlighting of GPTEL_BOUNDS."
  (interactive)
  (if gptel-bounds-overlay
      (progn
        (mapc 'delete-overlay gptel-bounds-overlay)
        (setq gptel-bounds-overlay nil)
        (message "GPTEL_BOUNDS highlighting removed."))
    (save-excursion
      (goto-char (point-min))
      (let ((bounds-str (org-entry-get (point) "GPTEL_BOUNDS")))
        (if bounds-str
            (let ((bounds (read bounds-str)))
              (highlight-bounds bounds)
              (message "GPTEL_BOUNDS highlighting enabled."))
          (message "No GPTEL_BOUNDS property found in the file."))))))

(global-set-key (kbd "C-c h") 'toggle-highlight-gptel-bounds)

if you execute this code you can toggle highlighting of system messages, and get a clearer image what is going on.
assistant messages are highlighted with a blue background, with the start and end character in a darker blue.
For example i had the following conversation:

you see that a system message is ending at character 971 and the next one starting right at 972. If i want to continue the chat with a second question, thats were empty user messages are created, an then claude complains.

[wlauppe]

thats the relevant snippet from gptel-log

(re-search-forward \":GPTEL_BOUNDS: (\" nil t)"
    },
    {
      "role": "user",
      "content": ""
    },
    {
      "role": "assistant",
      "content": "\n      (let ((bounds

[karthink]

@agzam, @wlauppe could you try it now? I added a clause to the logic for Anthropic where I don't include "empty" user prompts in the message.

(Even if this works, this is a stopgap solution -- as I haven't been able to find a response tracking method that is both robust and simple.)

[agzam]

Apologies for the delay, just wanted to make sure it's good. This is what I have in my config

(setq gptel-default-mode 'org-mode)
(setf (alist-get 'org-mode gptel-prompt-prefix-alist) "* ")

Sorry, with org-indent-mode my converstations were weirdly shifting onto the right, so I removed a few asterisks.

Been using it for a couple of days, so far no issues with the requests. Looks good. Thank you very much.

[karthink]

Closing this now.

@wlauppe and @agzam, feel free to reopen if you can still reproduce the error.

[wlauppe]

karthik, if you write an updated :GPTEL_BOUNDS: line, do you account for the changes in length?
For example if it had length 10 and the new :GPTEL_BOUNDS: line has length 20. the number in the
cons cell should be 10 higher, becouse GPTEL_BOUNDS is inserted at the beginning of the buffer. (359 . 835) (836 . 2720) becomes (369 . 845) (846 . 2730) do you do that?