Refusal to apologise suggests colonialism was justified