Duh moment! You can add a new paragraph within a Google Sheet cell by just clicking CTRL + Enter

I am logging this because for a long time I didn’t use Google Sheets for multiple paragraph data because I thought that cells had a one line limitation. Then I Googled it, finally.

Lesson here is: Never assume any software limitation, especially when it’s something so widely-used.

Source of solution came form Google Product Forums.