Can I assign agents to various departments and group them within themselves?

You can create a department by following the User Groups → Add User Group steps from the main screen and specifying the name of the group and the people in the tab that opens.