After creating app, by default you can find the FeedbackWidget in Atlas_Default, Atlas_TopBar layouts, you can delete this FeedbackWidget snippet from these two layouts.
In your page layout there probably is a snippet called ‘FeedbackWidget’. Either delete the widget from the lay-out or create a custom layout to remove it.