How to rebuild indexes in SQL Server Database

Yes, you can do it by using SQL Server Management Studio or using T-SQL.

Execute the below query

USE AdventureWorks2012;
GO
ALTER INDEX PK_Employee_BusinessEntityID ON HumanResources.Employee
REBUILD;
GO

No this query is only to rebuild a defragmented index. But you can rebuild all indexes in a table by using the following query

USE AdventureWorks2012;
GO
ALTER INDEX ALL ON Production.Product
REBUILD WITH (FILLFACTOR = 80, SORT_IN_TEMPDB = ON,
              STATISTICS_NORECOMPUTE = ON);
GO