It is not very obvious. You can create links using a formula and Excel's Hyperlink() function. Not tested, but something like this
SpreadsheetSetCellFormula(sheet, 'HYPERLINK("http://www.adobe.com", "Go Here")', rowNumber, columnNumber);
That works! However it does not appear in blue and underline but there is an easy fix with SpreadsheetFormatCell.