Datahub: ORDERS NOT RECEIVED ALL CUSTOMER, Kafka service is down

Creation date: 22/08/2022 11:00    Updated: 22/08/2022 11:00   #datahub #kafkaservice
Question:

Affected Environment:

PROD

Affected warehouse:

All Warehouse and Retail


Screenshots of error messages:


Time when issue occurred:


Last interface in Datahub on 12:05am 19 Aug 2022. 


Affected module:

Shipment order


Detailed description of issue:

1. Orders not received in the HLS system.

2. Checked the datahub and found no orders inside.


3. In Datahub lasst order was 12:05 AM.


Answer:

That is because the Kafka log is full:

GDex IT maintenance team should maintain this:


step 1: stop kafka 
step 2: backup & delete all 
step 3: start kafka



Investigation:

Kafka service went down. Restart service then the orders start coming in.
Files