I am setting up a project team and keep hearing that diversity is important. Does it mean that I should compose my team primarily of women or people from ethnic minorities?

No, this is not what is meant. Remember that diversity is not just limited to ethnic minorities and women. You should select the best people for the job and you are encouraged to select team members with a rich set of ideas, different backgrounds and perspectives  to contribute to the project.