Get category data from the category table instead of the category index

[eddetollenaer]

Issue Brief

As far as we see in the code, while creating the XML feed, the categories for a product are retrieved from the index instead of the categories table. We experience that the feed randomly does not connect all the (in Magento connected) categories to some products. This happens completely random, so each time it can be different products with different results. Some products have no categories attached and some products just have part of the Magento categories attached in the feed. If we generate the feed manually on the Magento feed (bin/magento tweakwise:export), the categories get attached to the products that were first missing them. But, the problem may arise for other products at the same time.

We "think" that this may occur because of the fact that we also have a delta import from Akeneo that runs every 15 minutes that updates our products with product info. At that moment, the index will be rebuilt too and maybe the Tweakwise export tries to get product data from the index that is corrupt at that moment for this reason.

So, in our opinion, it would be good to retrieve the categories for a product from the categories table instead of the index. The index is much more volatile than the product/categories table.

Environment

• PHP Version: 7.2.12
• Magento Version: 2.3.4
• Magento Enterprise: yes
• Tweakwise Export Version: 1.5
• Magento Deploy Mode: production
• Third party modules: Akeneo Pimgento (with custom code)

Steps to reproduce

See description above

Actual result

Products in the feed are not connected to all the categories that are connected to the product in Magento

Expected result

Products in the feed are connected to all the categories that they are connected to in Magento