It looks like Microsoft is now rolling out a new update for its Preview program for the Xbox One that fixes some responsiveness issue. The update is starting to roll out from today and you can check for it in the system update manually. The update brings the version up to xb_rel_1411.141023-2232.
According to the Xbox post on Reddit, the update fixes the following issue:
A fix for an issue some users reported where returning to Home from a game was unresponsive.
Have you downloaded the update yet? Did it fix the freezing issue?