The former Leicester City defender is aiming to emulate the Blades like they did last season and achieve promotion to the Premiership - a league they dropped out of in the year 2000.
The Owls have since been relegated to League One only to win promotion via the Play-Offs after a two year absence in 2004, they successfully avoided relegation under the leadership of Paul Sturroock last season.
Gilbert told icons.com "This is a massive club with a massive fan base and a fantastic stadium. We should be in the Premiership and that has to be our objective.
Obviously with Sheffield United in the Premiership there is pressure on us to emulate that, but even without United we would be under enormous pressure to succeed."