Desert dust plays an important role in the climate system through its impact on Earth's radiative budget and its role in the biogeochemical cycle as a source of iron in high-nutrient-low-chlorophyll regions. A large degree of diversity exists between the many global models that simulate the dust cycle to estimate its impact on climate. We present the results of a broad intercomparison of a total of 15 global aerosol models within the AeroCom project. Each model is compared to observations focusing on variables responsible for the uncertainties in estimating the direct radiative effect and the dust impact on the biogeochemical cycle, i.e., aerosol optical depth (AOD) and dust deposition. Additional comparisons to Angström Exponent (AE), coarse mode AOD and dust surface concentration are included to extend the assessment of model performance. These datasets form a benchmark data set which is proposed for model inspection and future dust model developments. In general, models perform better in simulating climatology of vertically averaged integrated parameters (AOD and AE) in dusty sites than they do with total deposition and surface concentration. Almost all models overestimate deposition fluxes over Europe, the Indian Ocean, the Atlantic Ocean and ice core data. Differences among the models arise when simulating deposition at remote sites with low fluxes over the Pacific and the Southern Atlantic Ocean. This study also highlights important differences in models ability to reproduce the deposition flux over Antarctica. The cause of this discrepancy could not be identified but different dust regimes at each site and issues with data quality should be considered. Models generally simulate better surface concentration at stations downwind of the main sources than at remote ones. Likewise, they simulate better surface concentration at stations affected by Saharan dust than at stations affected by Asian dust. Most models simulate the gradient in AOD and AE between the different dusty regions, however the seasonality and magnitude of both variables is better simulated at African stations than Middle East ones. The models also reproduce the dust transport across the Atlantic in terms of both AOD and AE; they simulate the offshore transport of West Africa throughout the year and limit the transport across the Atlantic to the summer months, yet overestimating the AOD and transporting too fine particles. However, most of the models do not reproduce the southward displacement of the dust cloud during the winter responsible of the transport of dust into South America. Based on the dependency of AOD on aerosol burden and size distribution we use model data bias with respect to AOD and AE and infer on the over/under estimation of the dust emissions. According to this we suggest the emissions in the Sahara be between 792 and 2271 Tg/yr and the one in the Middle East between 212 and 329 Tg/yr.