I agree with your premise, and here is some additional unsolicited information:

Vanilla ‘beans’ technically are fruit from hand-pollinated orchids! So scraping a seed pod or using extract makes no difference. It’s never been a bean.

Coffee ‘beans’ are seeds from the fruit of coffee trees and shrubs.