如何使用JSON生成的数字映射列

如何解决如何使用JSON生成的数字映射列

数据库中的数据的格式为

ID   QnA
asd  [{"No":1,"Question":"What is your name","Answer":"AAA"},{"No":2,"Question":"What is fav 
     sport?","Answer":"Soccer"},{"No":3,"Question":"What is the best show","Answer":"Friends"}]

dsa  [{"No":1,"Question":"What kind of food you like","Answer":"Indian"},"Question":"What is fav 
     restaurant?","Answer":"Taj mahal"},"Question":"What is your fav vaccation","Answer":"with 
     friends"}]
ssd  ...............

我希望输出映射为：

ID    No    Question                             Answer
asd   1     What is your name                    AAA
asd   2     .....                                ....
...
dsa   1    What kind of food you like            Indian
dsa   2    ....                                  ....

我正在使用数据块，并尝试将JSON部分数据转换为另一个表。但是不确定这是否是最好的方法。有没有办法使用PySpark达到预期的输出？

任何建议都会很有帮助。让我知道是否需要分享其他详细信息。