If you are using Selenium-WebDriver, you don’t need the Selenium Server as it is using totally different technology
Selenium Server provides Selenium RC functionality which is used for Selenium 1.0 backwards compatibility
Selenium Web driver makes direct calls to browser using each browsers native support for automation, while Selenium RC requires selenium server to inject Javascript into the browser