Extracted from Pike v8.0 release 28 as of 2015-08-03.
   

Method Parser.C.tokenize()


Method tokenize

array(Token) tokenize(array(string) s, void|string file)

Description

Returns an array of Token objects given an array of string tokens.