Real estate investment trusts that buy mortgage-backed securities rather than buildings or land are posting double-digit returns and attracting strong investment flows.