1. Open the RDLC Report in Visual Studio
2. Click on it and then press F4 key to open Properties
3. In the Properties Window Select Tablix from the DropDown
4. Then you need to navigate to No Rows section and there in the NoRowsMessage you need to set the message you want to display
And when you don't have data the following will get displayed.