There’s a warning to people with private or workplace pensions they could be leaving themselves in danger of emptying their retirement pots too soon.